Skip to content

perf[array]: outline the array parts data from the DynArray#7750

Merged
robert3005 merged 14 commits intodevelopfrom
ji/vtable-array-outer
May 6, 2026
Merged

perf[array]: outline the array parts data from the DynArray#7750
robert3005 merged 14 commits intodevelopfrom
ji/vtable-array-outer

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented May 1, 2026

Change the internals of ArrayRef to allow access to common fields without dyn dispatch.

+ pub struct ArrayRef(Arc<ArrayInner<dyn DynArrayData>>);
- pub struct ArrayRef(Arc<dyn DynArray>);
pub(crate) struct ArrayInner<D: ?Sized> {
    pub(crate) len: usize,
    pub(crate) encoding_id: ArrayId,
    pub(crate) dtype: DType,
    pub(crate) slots: Vec<Option<ArrayRef>>,
    pub(crate) stats: ArrayStats,
    pub(crate) data: D, // must be last for unsized coercion
}

Applied the following renames:

  • ArrayInner -> ArrayData
  • <V as VTable>::ArrayData -> <V as VTable>::TypedArrayData
  • DynArray -> DynArrayData

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/array/erased.rs
@joseph-isaacs joseph-isaacs changed the title wip do not merge: try out a new array memory layout May 1, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 1, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 1, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: Random Access

Vortex (geomean): 0.977x ➖
Parquet (geomean): 1.018x ➖


unknown / unknown (1.006x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2138874 2201627 0.97
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1510180 1471153 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8368293370 8366468950 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8320122859 8338957244 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7454264 7839563 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7082807 7252897 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 5884021 5737865 1.03
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 6681698 6522869 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8350732629 8246749502 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8300445044 8197881469 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12834210 13194765 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12688483 13158730 0.96
random-access/lance-tokio-local-disk 781925 780190 1.00
random-access/lance-tokio-local-disk-footer 1364876 1361448 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 254218 246293 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 653806 622221 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk 130364299 127602942 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131010926 127333250 1.03
random-access/nested-lists/correlated/vortex-tokio-local-disk 586027 576617 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 629558 596028 1.06
random-access/nested-lists/uniform/lance-tokio-local-disk 1134570 1108734 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1551945 1477262 1.05
random-access/nested-lists/uniform/parquet-tokio-local-disk 131474018 127477057 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130941250 127386280 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 2146727 2093679 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2134388 2094718 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk 413894 394616 1.05
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 620211 593847 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk 21675852 21322043 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 21918566 21343909 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk 778470 776476 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 709706 734252 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2812073 2741746 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3001462 2950674 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 22434597 21269327 1.05
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22127060 21203565 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk 1660816 1592397 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1665616 1554565 1.07
random-access/parquet-tokio-local-disk 169100436 164794018 1.03
random-access/parquet-tokio-local-disk-footer 167926260 165707096 1.01
random-access/taxi/correlated/lance-tokio-local-disk 974100 963992 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1649373 1590756 1.04
random-access/taxi/correlated/parquet-tokio-local-disk 252054067 252781862 1.00
random-access/taxi/correlated/parquet-tokio-local-disk-footer 251423488 251590793 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1586671 1852357 0.86
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1732625 1841305 0.94
random-access/taxi/uniform/lance-tokio-local-disk 9659797 9415402 1.03
random-access/taxi/uniform/lance-tokio-local-disk-footer 10260506 10151258 1.01
random-access/taxi/uniform/parquet-tokio-local-disk 265880392 263571240 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 265907806 264154231 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 4511029 4624864 0.98
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4473800 4606158 0.97
random-access/vortex-tokio-local-disk 1171208 1290872 0.91
random-access/vortex-tokio-local-disk-footer 🚀 1191689 1326956 0.90

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: Compression

Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.029x ➖


unknown / unknown (1.039x ➖, 2↑ 21↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
compress time/Arade 1204412549 1142528953 1.05
compress time/Bimbo 7166645324 6821495731 1.05
compress time/CMSprovider 3005206976 2837659527 1.06
compress time/Euro2016 461779903 430323086 1.07
compress time/Food 402802479 384890746 1.05
compress time/HashTags 841985046 832645156 1.01
compress time/TPC-H l_comment canonical 1368765135 1274610453 1.07
compress time/TPC-H l_comment chunked 1385611730 1279809568 1.08
compress time/taxi 741781144 705231305 1.05
compress time/wide table cols=100 chunks=1 rows=1000 11876466 12076417 0.98
compress time/wide table cols=100 chunks=50 rows=1000 12114111 11755154 1.03
compress time/wide table cols=1000 chunks=1 rows=1000 130173681 125266851 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 130432588 130422207 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1505164431 1436245715 1.05
compress time/wide table cols=10000 chunks=50 rows=1000 1497933431 1419196284 1.06
decompress time/Arade 🚨 29133598 25474156 1.14
decompress time/Bimbo 🚨 89170992 77020915 1.16
decompress time/CMSprovider 🚨 96816492 72217628 1.34
decompress time/Euro2016 19543806 18582833 1.05
decompress time/Food 🚨 9068475 7598072 1.19
decompress time/HashTags 73395332 68440717 1.07
decompress time/TPC-H l_comment canonical 🚨 43536301 39418029 1.10
decompress time/TPC-H l_comment chunked 🚨 44225988 39522092 1.12
decompress time/taxi 🚨 16748404 14649360 1.14
decompress time/wide table cols=100 chunks=1 rows=1000 2616574 2436589 1.07
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2807005 2478227 1.13
decompress time/wide table cols=1000 chunks=1 rows=1000 24974605 22775027 1.10
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 25846953 22847832 1.13
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 289949516 244929126 1.18
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 291020964 246418627 1.18
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2683762969 2567810601 1.05
parquet_rs-zstd compress time/Bimbo 12771856092 12352703876 1.03
parquet_rs-zstd compress time/CMSprovider 7189159830 6791354737 1.06
parquet_rs-zstd compress time/Euro2016 1363057270 1304986698 1.04
parquet_rs-zstd compress time/Food 811762019 781615947 1.04
parquet_rs-zstd compress time/HashTags 2306606992 2103455012 1.10
parquet_rs-zstd compress time/TPC-H l_comment canonical 3255053875 3124671994 1.04
parquet_rs-zstd compress time/TPC-H l_comment chunked 3256728453 3125208807 1.04
parquet_rs-zstd compress time/taxi 1253098423 1192069755 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7029923 6093841 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7198867 6030200 1.19
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 80228760 73161754 1.10
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 80025649 74078278 1.08
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 828637886 798370854 1.04
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 809343115 814924826 0.99
parquet_rs-zstd decompress time/Arade 626404666 613187942 1.02
parquet_rs-zstd decompress time/Bimbo 1698299468 1695816283 1.00
parquet_rs-zstd decompress time/CMSprovider 1764934590 1682181383 1.05
parquet_rs-zstd decompress time/Euro2016 382517081 375036132 1.02
parquet_rs-zstd decompress time/Food 202565626 195836766 1.03
parquet_rs-zstd decompress time/HashTags 🚨 683344243 614732477 1.11
parquet_rs-zstd decompress time/TPC-H l_comment canonical 594441783 584551328 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 595589231 585303407 1.02
parquet_rs-zstd decompress time/taxi 246915900 245777316 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2970064 2799348 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2996870 2780684 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34485582 31901518 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35164001 33130462 1.06
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 359516416 344577984 1.04
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 355507674 344143494 1.03
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163394324 163395292 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.85
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.86
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.28
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.15
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.10
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -0.6%


datafusion / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 725606790 870351985 0.83
tpch_q02/datafusion:vortex-file-compressed 1047726244 1137695987 0.92
tpch_q03/datafusion:vortex-file-compressed 856887863 1111018849 0.77
tpch_q04/datafusion:vortex-file-compressed 675515230 767753349 0.88
tpch_q05/datafusion:vortex-file-compressed 1141301362 1044050114 1.09
tpch_q06/datafusion:vortex-file-compressed 723974142 681812032 1.06
tpch_q07/datafusion:vortex-file-compressed 1142964604 1334880536 0.86
tpch_q08/datafusion:vortex-file-compressed 1486096062 1193823669 1.24
tpch_q09/datafusion:vortex-file-compressed 1329846108 1305372609 1.02
tpch_q10/datafusion:vortex-file-compressed 1024884592 1132811669 0.90
tpch_q11/datafusion:vortex-file-compressed 634586292 510971744 1.24
tpch_q12/datafusion:vortex-file-compressed 1074691457 1125347018 0.95
tpch_q13/datafusion:vortex-file-compressed 465269742 458612711 1.01
tpch_q14/datafusion:vortex-file-compressed 735389312 682120962 1.08
tpch_q15/datafusion:vortex-file-compressed 1262840797 1200098983 1.05
tpch_q16/datafusion:vortex-file-compressed 369837481 405095183 0.91
tpch_q17/datafusion:vortex-file-compressed 1196683799 1166586089 1.03
tpch_q18/datafusion:vortex-file-compressed 1278424210 1173545843 1.09
tpch_q19/datafusion:vortex-file-compressed 802448284 925836333 0.87
tpch_q20/datafusion:vortex-file-compressed 1020053694 1161917525 0.88
tpch_q21/datafusion:vortex-file-compressed 1818769069 1625857825 1.12
tpch_q22/datafusion:vortex-file-compressed 🚨 592228361 397897781 1.49
datafusion / vortex-compact (1.044x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 674722535 681272619 0.99
tpch_q02/datafusion:vortex-compact 830281954 705289468 1.18
tpch_q03/datafusion:vortex-compact 829467892 976064333 0.85
tpch_q04/datafusion:vortex-compact 649514280 602699106 1.08
tpch_q05/datafusion:vortex-compact 1120820346 948523777 1.18
tpch_q06/datafusion:vortex-compact 688176713 627218383 1.10
tpch_q07/datafusion:vortex-compact 993568513 945091946 1.05
tpch_q08/datafusion:vortex-compact 1096369154 1032216601 1.06
tpch_q09/datafusion:vortex-compact 1213399797 1117787754 1.09
tpch_q10/datafusion:vortex-compact 920761585 895125337 1.03
tpch_q11/datafusion:vortex-compact 512511632 405208551 1.26
tpch_q12/datafusion:vortex-compact 922993794 775059493 1.19
tpch_q13/datafusion:vortex-compact 429178249 423262363 1.01
tpch_q14/datafusion:vortex-compact 852210775 668350456 1.28
tpch_q15/datafusion:vortex-compact 1278032681 1478543143 0.86
tpch_q16/datafusion:vortex-compact 354934250 346998754 1.02
tpch_q17/datafusion:vortex-compact 1342545794 1150584165 1.17
tpch_q18/datafusion:vortex-compact 1096062940 1115401920 0.98
tpch_q19/datafusion:vortex-compact 861417595 893876250 0.96
tpch_q20/datafusion:vortex-compact 1146897955 1130252659 1.01
tpch_q21/datafusion:vortex-compact 1834861739 1761871484 1.04
tpch_q22/datafusion:vortex-compact 428135219 575399588 0.74
datafusion / parquet (0.984x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1016606590 920645865 1.10
tpch_q02/datafusion:parquet 1513095027 1204575297 1.26
tpch_q03/datafusion:parquet 1034739083 1121521694 0.92
tpch_q04/datafusion:parquet 498930593 515202184 0.97
tpch_q05/datafusion:parquet 1381789527 1210751180 1.14
tpch_q06/datafusion:parquet 639258212 561225199 1.14
tpch_q07/datafusion:parquet 1575698298 1463527526 1.08
tpch_q08/datafusion:parquet 1887515803 1628022334 1.16
tpch_q09/datafusion:parquet 2328851359 1813227305 1.28
tpch_q10/datafusion:parquet 2135856450 2202224452 0.97
tpch_q11/datafusion:parquet 609931894 572700551 1.07
tpch_q12/datafusion:parquet 710205531 879622662 0.81
tpch_q13/datafusion:parquet 717012684 1003402089 0.71
tpch_q14/datafusion:parquet 806758686 903289571 0.89
tpch_q15/datafusion:parquet 1258485776 1441802953 0.87
tpch_q16/datafusion:parquet 504052490 593591176 0.85
tpch_q17/datafusion:parquet 1386744368 1340143277 1.03
tpch_q18/datafusion:parquet 1730848285 1662230218 1.04
tpch_q19/datafusion:parquet 887318050 1124104951 0.79
tpch_q20/datafusion:parquet 1086940025 1182587927 0.92
tpch_q21/datafusion:parquet 1804641689 1748685699 1.03
tpch_q22/datafusion:parquet 811777715 948172232 0.86
duckdb / vortex-file-compressed (0.954x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 623922673 676021506 0.92
tpch_q02/duckdb:vortex-file-compressed 1287467008 1191394235 1.08
tpch_q03/duckdb:vortex-file-compressed 937712124 1053123735 0.89
tpch_q04/duckdb:vortex-file-compressed 692662990 601662889 1.15
tpch_q05/duckdb:vortex-file-compressed 1191500152 1145678043 1.04
tpch_q06/duckdb:vortex-file-compressed 773082925 821923419 0.94
tpch_q07/duckdb:vortex-file-compressed 1219989685 1300031640 0.94
tpch_q08/duckdb:vortex-file-compressed 1393778128 1649917217 0.84
tpch_q09/duckdb:vortex-file-compressed 1387052870 1590733646 0.87
tpch_q10/duckdb:vortex-file-compressed 1057665764 1241697439 0.85
tpch_q11/duckdb:vortex-file-compressed 653545008 698388008 0.94
tpch_q12/duckdb:vortex-file-compressed 710443017 826649354 0.86
tpch_q13/duckdb:vortex-file-compressed 984066976 970153355 1.01
tpch_q14/duckdb:vortex-file-compressed 842763647 880644291 0.96
tpch_q15/duckdb:vortex-file-compressed 537600966 541304830 0.99
tpch_q16/duckdb:vortex-file-compressed 569115101 506822550 1.12
tpch_q17/duckdb:vortex-file-compressed 937420184 946926836 0.99
tpch_q18/duckdb:vortex-file-compressed 908029470 936772509 0.97
tpch_q19/duckdb:vortex-file-compressed 741653365 965481407 0.77
tpch_q20/duckdb:vortex-file-compressed 1153569066 1390846464 0.83
tpch_q21/duckdb:vortex-file-compressed 2010546050 2055517147 0.98
tpch_q22/duckdb:vortex-file-compressed 737933369 637279995 1.16
duckdb / vortex-compact (0.979x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 593283950 612902705 0.97
tpch_q02/duckdb:vortex-compact 1089213845 1055762440 1.03
tpch_q03/duckdb:vortex-compact 878003097 848086598 1.04
tpch_q04/duckdb:vortex-compact 554034110 567039242 0.98
tpch_q05/duckdb:vortex-compact 1037648354 1013814641 1.02
tpch_q06/duckdb:vortex-compact 701792190 757310998 0.93
tpch_q07/duckdb:vortex-compact 1033957015 1088049529 0.95
tpch_q08/duckdb:vortex-compact 1320795293 1375631690 0.96
tpch_q09/duckdb:vortex-compact 1357846034 1331364855 1.02
tpch_q10/duckdb:vortex-compact 1077706273 1039198139 1.04
tpch_q11/duckdb:vortex-compact 610676188 721795121 0.85
tpch_q12/duckdb:vortex-compact 708741361 676353224 1.05
tpch_q13/duckdb:vortex-compact 879545028 860474908 1.02
tpch_q14/duckdb:vortex-compact 829927616 838655869 0.99
tpch_q15/duckdb:vortex-compact 512075010 537266097 0.95
tpch_q16/duckdb:vortex-compact 430352605 503988770 0.85
tpch_q17/duckdb:vortex-compact 891003029 849540073 1.05
tpch_q18/duckdb:vortex-compact 747569911 692148491 1.08
tpch_q19/duckdb:vortex-compact 705079120 745937297 0.95
tpch_q20/duckdb:vortex-compact 1202427025 1165411000 1.03
tpch_q21/duckdb:vortex-compact 1705334532 1791238225 0.95
tpch_q22/duckdb:vortex-compact 643885722 726798949 0.89
duckdb / parquet (0.966x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 969177060 921439942 1.05
tpch_q02/duckdb:parquet 1296490463 1689699549 0.77
tpch_q03/duckdb:parquet 1790413495 1723028650 1.04
tpch_q04/duckdb:parquet 1063239450 1051408299 1.01
tpch_q05/duckdb:parquet 1948284581 2027280066 0.96
tpch_q06/duckdb:parquet 917809620 852186882 1.08
tpch_q07/duckdb:parquet 1884340672 1818974937 1.04
tpch_q08/duckdb:parquet 2452782676 2557063658 0.96
tpch_q09/duckdb:parquet 2542254412 2613755266 0.97
tpch_q10/duckdb:parquet 3117441908 3286108919 0.95
tpch_q11/duckdb:parquet 916579794 1093496926 0.84
tpch_q12/duckdb:parquet 1197911595 1152563760 1.04
tpch_q13/duckdb:parquet 1394243780 1286173232 1.08
tpch_q14/duckdb:parquet 1367498559 1337312397 1.02
tpch_q15/duckdb:parquet 911700188 980785733 0.93
tpch_q16/duckdb:parquet 814785506 906751521 0.90
tpch_q17/duckdb:parquet 1287371448 1294527465 0.99
tpch_q18/duckdb:parquet 1404980056 1523931439 0.92
tpch_q19/duckdb:parquet 1472258329 1496612037 0.98
tpch_q20/duckdb:parquet 1872393914 2078653816 0.90
tpch_q21/duckdb:parquet 2040020856 1883981093 1.08
tpch_q22/duckdb:parquet 958982266 1172443443 0.82
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.0% +7.8% -8.1% +38.7% ➖ noise
1 datafusion:vortex-file-compressed -16.6% +7.8% -22.6% +52.1% ➖ noise
1 duckdb:vortex-compact -3.2% +7.8% -10.2% +109.1% ➖ noise
1 duckdb:vortex-file-compressed -7.7% +7.8% -14.4% +39.5% ➖ noise
2 datafusion:vortex-compact +17.7% -1.8% +19.9% +42.3% ➖ noise
2 datafusion:vortex-file-compressed -7.9% -1.8% -6.2% +45.6% ➖ noise
2 duckdb:vortex-compact +3.2% -1.8% +5.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +8.1% -1.8% +10.1% +30.9% ➖ noise
3 datafusion:vortex-compact -15.0% -2.1% -13.2% +42.4% ➖ noise
3 datafusion:vortex-file-compressed -22.9% -2.1% -21.2% +51.6% ➖ noise
3 duckdb:vortex-compact +3.5% -2.1% +5.7% +36.9% ➖ noise
3 duckdb:vortex-file-compressed -11.0% -2.1% -9.1% +39.8% ➖ noise
4 datafusion:vortex-compact +7.8% -1.0% +8.9% +31.5% ➖ noise
4 datafusion:vortex-file-compressed -12.0% -1.0% -11.1% +30.0% ➖ noise
4 duckdb:vortex-compact -2.3% -1.0% -1.3% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +15.1% -1.0% +16.3% +30.0% ➖ noise
5 datafusion:vortex-compact +18.2% +4.7% +12.8% +41.8% ➖ noise
5 datafusion:vortex-file-compressed +9.3% +4.7% +4.4% +34.3% ➖ noise
5 duckdb:vortex-compact +2.4% +4.7% -2.3% +33.7% ➖ noise
5 duckdb:vortex-file-compressed +4.0% +4.7% -0.7% +34.3% ➖ noise
6 datafusion:vortex-compact +9.7% +10.8% -0.9% +49.5% ➖ noise
6 datafusion:vortex-file-compressed +6.2% +10.8% -4.1% +40.1% ➖ noise
6 duckdb:vortex-compact -7.3% +10.8% -16.3% +39.3% ➖ noise
6 duckdb:vortex-file-compressed -5.9% +10.8% -15.1% +37.5% ➖ noise
7 datafusion:vortex-compact +5.1% +5.6% -0.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -14.4% +5.6% -18.9% +30.0% ➖ noise
7 duckdb:vortex-compact -5.0% +5.6% -10.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.2% +5.6% -11.1% +30.0% ➖ noise
8 datafusion:vortex-compact +6.2% +5.5% +0.7% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +24.5% +5.5% +18.0% +30.0% ➖ noise
8 duckdb:vortex-compact -4.0% +5.5% -9.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -15.5% +5.5% -19.9% +30.0% ➖ noise
9 datafusion:vortex-compact +8.6% +11.8% -2.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +1.9% +11.8% -8.9% +30.0% ➖ noise
9 duckdb:vortex-compact +2.0% +11.8% -8.8% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -12.8% +11.8% -22.0% +30.0% ➖ noise
10 datafusion:vortex-compact +2.9% -4.1% +7.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -9.5% -4.1% -5.7% +41.3% ➖ noise
10 duckdb:vortex-compact +3.7% -4.1% +8.1% +73.2% ➖ noise
10 duckdb:vortex-file-compressed -14.8% -4.1% -11.2% +31.0% ➖ noise
11 datafusion:vortex-compact +26.5% -5.5% +33.9% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed +24.2% -5.5% +31.4% +30.0% 🚨 regression
11 duckdb:vortex-compact -15.4% -5.5% -10.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -6.4% -5.5% -1.0% +30.0% ➖ noise
12 datafusion:vortex-compact +19.1% -8.4% +30.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -4.5% -8.4% +4.2% +30.0% ➖ noise
12 duckdb:vortex-compact +4.8% -8.4% +14.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -14.1% -8.4% -6.2% +30.0% ➖ noise
13 datafusion:vortex-compact +1.4% -12.0% +15.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +1.5% -12.0% +15.3% +30.0% ➖ noise
13 duckdb:vortex-compact +2.2% -12.0% +16.1% +38.8% ➖ noise
13 duckdb:vortex-file-compressed +1.4% -12.0% +15.2% +41.9% ➖ noise
14 datafusion:vortex-compact +27.5% -4.4% +33.4% +33.8% ➖ noise
14 datafusion:vortex-file-compressed +7.8% -4.4% +12.8% +30.0% ➖ noise
14 duckdb:vortex-compact -1.0% -4.4% +3.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -4.3% -4.4% +0.1% +30.0% ➖ noise
15 datafusion:vortex-compact -13.6% -9.9% -4.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +5.2% -9.9% +16.8% +30.0% ➖ noise
15 duckdb:vortex-compact -4.7% -9.9% +5.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -0.7% -9.9% +10.3% +30.0% ➖ noise
16 datafusion:vortex-compact +2.3% -12.6% +17.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -8.7% -12.6% +4.5% +32.8% ➖ noise
16 duckdb:vortex-compact -14.6% -12.6% -2.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +12.3% -12.6% +28.6% +30.0% ➖ noise
17 datafusion:vortex-compact +16.7% +1.4% +15.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.6% +1.4% +1.1% +30.0% ➖ noise
17 duckdb:vortex-compact +4.9% +1.4% +3.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -1.0% +1.4% -2.4% +30.0% ➖ noise
18 datafusion:vortex-compact -1.7% -2.0% +0.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +8.9% -2.0% +11.2% +30.0% ➖ noise
18 duckdb:vortex-compact +8.0% -2.0% +10.2% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.1% -2.0% -1.1% +30.0% ➖ noise
19 datafusion:vortex-compact -3.6% -11.9% +9.4% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -13.3% -11.9% -1.6% +30.0% ➖ noise
19 duckdb:vortex-compact -5.5% -11.9% +7.3% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -23.2% -11.9% -12.8% +30.0% ➖ noise
20 datafusion:vortex-compact +1.5% -9.0% +11.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -12.2% -9.0% -3.5% +30.0% ➖ noise
20 duckdb:vortex-compact +3.2% -9.0% +13.4% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -17.1% -9.0% -8.8% +30.0% ➖ noise
21 datafusion:vortex-compact +4.1% +5.7% -1.5% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +11.9% +5.7% +5.8% +30.0% ➖ noise
21 duckdb:vortex-compact -4.8% +5.7% -9.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.2% +5.7% -7.5% +30.0% ➖ noise
22 datafusion:vortex-compact -25.6% -16.3% -11.1% +51.6% ➖ noise
22 datafusion:vortex-file-compressed +48.8% -16.3% +77.9% +48.3% 🚨 regression
22 duckdb:vortex-compact -11.4% -16.3% +5.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +15.8% -16.3% +38.4% +35.2% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.6%


datafusion / vortex-file-compressed (0.884x ➖, 2↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 322296747 320831650 1.00
tpch_q02/datafusion:vortex-file-compressed 454595199 588343073 0.77
tpch_q03/datafusion:vortex-file-compressed 418023216 543349651 0.77
tpch_q04/datafusion:vortex-file-compressed 259204912 354830404 0.73
tpch_q05/datafusion:vortex-file-compressed 🚀 457985978 714820926 0.64
tpch_q06/datafusion:vortex-file-compressed 352862962 409999275 0.86
tpch_q07/datafusion:vortex-file-compressed 470026463 539826397 0.87
tpch_q08/datafusion:vortex-file-compressed 600994891 809323471 0.74
tpch_q09/datafusion:vortex-file-compressed 🚀 452820245 831520212 0.54
tpch_q10/datafusion:vortex-file-compressed 548056502 747429412 0.73
tpch_q11/datafusion:vortex-file-compressed 407542517 410496229 0.99
tpch_q12/datafusion:vortex-file-compressed 557008539 614161366 0.91
tpch_q13/datafusion:vortex-file-compressed 214752380 168202417 1.28
tpch_q14/datafusion:vortex-file-compressed 338532014 337456325 1.00
tpch_q15/datafusion:vortex-file-compressed 592638035 672987979 0.88
tpch_q16/datafusion:vortex-file-compressed 213957888 217086200 0.99
tpch_q17/datafusion:vortex-file-compressed 397316252 463839737 0.86
tpch_q18/datafusion:vortex-file-compressed 328819620 335457516 0.98
tpch_q19/datafusion:vortex-file-compressed 512742357 452187470 1.13
tpch_q20/datafusion:vortex-file-compressed 495947534 666750200 0.74
tpch_q21/datafusion:vortex-file-compressed 724116139 658706968 1.10
tpch_q22/datafusion:vortex-file-compressed 🚨 156523099 113774337 1.38
datafusion / vortex-compact (1.013x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 345149273 371463516 0.93
tpch_q02/datafusion:vortex-compact 459318546 470090461 0.98
tpch_q03/datafusion:vortex-compact 387848487 491184087 0.79
tpch_q04/datafusion:vortex-compact 261107666 236417701 1.10
tpch_q05/datafusion:vortex-compact 414346708 483719279 0.86
tpch_q06/datafusion:vortex-compact 🚀 361451254 517774914 0.70
tpch_q07/datafusion:vortex-compact 518362808 454862020 1.14
tpch_q08/datafusion:vortex-compact 605486497 569292432 1.06
tpch_q09/datafusion:vortex-compact 493616491 434999806 1.13
tpch_q10/datafusion:vortex-compact 589992712 510948146 1.15
tpch_q11/datafusion:vortex-compact 375974442 307273291 1.22
tpch_q12/datafusion:vortex-compact 530140993 497263727 1.07
tpch_q13/datafusion:vortex-compact 156074702 131059106 1.19
tpch_q14/datafusion:vortex-compact 318951112 272331906 1.17
tpch_q15/datafusion:vortex-compact 459864294 475515355 0.97
tpch_q16/datafusion:vortex-compact 180637295 216974631 0.83
tpch_q17/datafusion:vortex-compact 376591531 371056328 1.01
tpch_q18/datafusion:vortex-compact 🚨 469293811 322995748 1.45
tpch_q19/datafusion:vortex-compact 542063610 509808349 1.06
tpch_q20/datafusion:vortex-compact 580219465 498305483 1.16
tpch_q21/datafusion:vortex-compact 601633297 730012679 0.82
tpch_q22/datafusion:vortex-compact 119095798 147443013 0.81
datafusion / parquet (1.014x ➖, 0↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 272869508 257469592 1.06
tpch_q02/datafusion:parquet 515018214 418918802 1.23
tpch_q03/datafusion:parquet 🚨 458216545 303512328 1.51
tpch_q04/datafusion:parquet 191180530 179229865 1.07
tpch_q05/datafusion:parquet 503578157 532854640 0.95
tpch_q06/datafusion:parquet 155452439 159634765 0.97
tpch_q07/datafusion:parquet 507467690 525519502 0.97
tpch_q08/datafusion:parquet 597898127 611735393 0.98
tpch_q09/datafusion:parquet 459284022 548390727 0.84
tpch_q10/datafusion:parquet 513726372 568177276 0.90
tpch_q11/datafusion:parquet 355004315 410040308 0.87
tpch_q12/datafusion:parquet 228059284 298652819 0.76
tpch_q13/datafusion:parquet 443559669 427492287 1.04
tpch_q14/datafusion:parquet 181320782 183975253 0.99
tpch_q15/datafusion:parquet 298278701 328956906 0.91
tpch_q16/datafusion:parquet 172996550 172471800 1.00
tpch_q17/datafusion:parquet 497385396 456768941 1.09
tpch_q18/datafusion:parquet 615652859 689129401 0.89
tpch_q19/datafusion:parquet 545508426 549222772 0.99
tpch_q20/datafusion:parquet 🚨 720242294 453192063 1.59
tpch_q21/datafusion:parquet 🚨 896213967 683053248 1.31
tpch_q22/datafusion:parquet 199617428 251390177 0.79
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 333468071 279571621 1.19
tpch_q02/duckdb:vortex-file-compressed 1008485466 960868692 1.05
tpch_q03/duckdb:vortex-file-compressed 662075807 737228854 0.90
tpch_q04/duckdb:vortex-file-compressed 424274798 401359617 1.06
tpch_q05/duckdb:vortex-file-compressed 1047287303 917525477 1.14
tpch_q06/duckdb:vortex-file-compressed 453863248 522582683 0.87
tpch_q07/duckdb:vortex-file-compressed 924342656 887989096 1.04
tpch_q08/duckdb:vortex-file-compressed 1081623794 1039591942 1.04
tpch_q09/duckdb:vortex-file-compressed 871538758 892685248 0.98
tpch_q10/duckdb:vortex-file-compressed 797164928 840443013 0.95
tpch_q11/duckdb:vortex-file-compressed 543461349 545763130 1.00
tpch_q12/duckdb:vortex-file-compressed 523188739 517430478 1.01
tpch_q13/duckdb:vortex-file-compressed 571503810 513817085 1.11
tpch_q14/duckdb:vortex-file-compressed 520515976 530004110 0.98
tpch_q15/duckdb:vortex-file-compressed 275148238 288611908 0.95
tpch_q16/duckdb:vortex-file-compressed 405889032 395231564 1.03
tpch_q17/duckdb:vortex-file-compressed 762718262 787748721 0.97
tpch_q18/duckdb:vortex-file-compressed 605938347 651653817 0.93
tpch_q19/duckdb:vortex-file-compressed 533699124 477606688 1.12
tpch_q20/duckdb:vortex-file-compressed 833797927 866046510 0.96
tpch_q21/duckdb:vortex-file-compressed 1141991541 1205025267 0.95
tpch_q22/duckdb:vortex-file-compressed 400371884 411146097 0.97
duckdb / vortex-compact (1.036x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 327358304 309834728 1.06
tpch_q02/duckdb:vortex-compact 967975312 931773154 1.04
tpch_q03/duckdb:vortex-compact 705598668 685426943 1.03
tpch_q04/duckdb:vortex-compact 412012320 338059877 1.22
tpch_q05/duckdb:vortex-compact 957621587 985431508 0.97
tpch_q06/duckdb:vortex-compact 486596784 501619857 0.97
tpch_q07/duckdb:vortex-compact 1030416064 900514592 1.14
tpch_q08/duckdb:vortex-compact 1032841772 922463763 1.12
tpch_q09/duckdb:vortex-compact 1057192611 924143829 1.14
tpch_q10/duckdb:vortex-compact 761246904 917174421 0.83
tpch_q11/duckdb:vortex-compact 487570163 479395109 1.02
tpch_q12/duckdb:vortex-compact 485491716 492403581 0.99
tpch_q13/duckdb:vortex-compact 492582308 502309707 0.98
tpch_q14/duckdb:vortex-compact 535029347 500662726 1.07
tpch_q15/duckdb:vortex-compact 311672101 300433464 1.04
tpch_q16/duckdb:vortex-compact 416870516 401614014 1.04
tpch_q17/duckdb:vortex-compact 680124317 722999560 0.94
tpch_q18/duckdb:vortex-compact 495511817 507959386 0.98
tpch_q19/duckdb:vortex-compact 473001861 434914876 1.09
tpch_q20/duckdb:vortex-compact 801721972 748330043 1.07
tpch_q21/duckdb:vortex-compact 1145819347 1073480453 1.07
tpch_q22/duckdb:vortex-compact 397326502 373620530 1.06
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 429622717 544612067 0.79
tpch_q02/duckdb:parquet 1257284105 1216130575 1.03
tpch_q03/duckdb:parquet 1178209792 1148515045 1.03
tpch_q04/duckdb:parquet 628061139 652025111 0.96
tpch_q05/duckdb:parquet 1425684549 1320991954 1.08
tpch_q06/duckdb:parquet 411538157 478382159 0.86
tpch_q07/duckdb:parquet 1209769737 1209623503 1.00
tpch_q08/duckdb:parquet 1637199870 1591635532 1.03
tpch_q09/duckdb:parquet 1466636235 1401590535 1.05
tpch_q10/duckdb:parquet 1440937437 1294968329 1.11
tpch_q11/duckdb:parquet 760630891 778452319 0.98
tpch_q12/duckdb:parquet 908883339 748012622 1.22
tpch_q13/duckdb:parquet 961715732 909368446 1.06
tpch_q14/duckdb:parquet 751974460 811334151 0.93
tpch_q15/duckdb:parquet 550757451 618969967 0.89
tpch_q16/duckdb:parquet 642914944 631718168 1.02
tpch_q17/duckdb:parquet 867370243 871529767 1.00
tpch_q18/duckdb:parquet 934909778 906412456 1.03
tpch_q19/duckdb:parquet 801713119 744560964 1.08
tpch_q20/duckdb:parquet 1164264697 1161404969 1.00
tpch_q21/duckdb:parquet 1173132782 1166707944 1.01
tpch_q22/duckdb:parquet 569604301 620080635 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.1% -8.6% +1.6% +72.0% ➖ noise
1 datafusion:vortex-file-compressed +0.5% -8.6% +9.9% +66.3% ➖ noise
1 duckdb:vortex-compact +5.7% -8.6% +15.6% +48.2% ➖ noise
1 duckdb:vortex-file-compressed +19.3% -8.6% +30.5% +45.2% ➖ noise
2 datafusion:vortex-compact -2.3% +12.7% -13.3% +38.0% ➖ noise
2 datafusion:vortex-file-compressed -22.7% +12.7% -31.5% +39.6% ✅ faster
2 duckdb:vortex-compact +3.9% +12.7% -7.9% +31.2% ➖ noise
2 duckdb:vortex-file-compressed +5.0% +12.7% -6.9% +32.2% ➖ noise
3 datafusion:vortex-compact -21.0% +24.4% -36.6% +54.4% ✅ faster
3 datafusion:vortex-file-compressed -23.1% +24.4% -38.2% +57.4% ✅ faster
3 duckdb:vortex-compact +2.9% +24.4% -17.3% +32.7% ➖ noise
3 duckdb:vortex-file-compressed -10.2% +24.4% -27.8% +47.9% ➖ noise
4 datafusion:vortex-compact +10.4% +1.4% +9.0% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -26.9% +1.4% -27.9% +37.8% ✅ faster
4 duckdb:vortex-compact +21.9% +1.4% +20.2% +33.0% ➖ noise
4 duckdb:vortex-file-compressed +5.7% +1.4% +4.3% +30.0% ➖ noise
5 datafusion:vortex-compact -14.3% +1.0% -15.2% +33.3% ➖ noise
5 datafusion:vortex-file-compressed -35.9% +1.0% -36.6% +30.0% ✅ faster
5 duckdb:vortex-compact -2.8% +1.0% -3.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +14.1% +1.0% +13.0% +30.0% ➖ noise
6 datafusion:vortex-compact -30.2% -8.5% -23.7% +32.7% ➖ noise
6 datafusion:vortex-file-compressed -13.9% -8.5% -6.0% +30.0% ➖ noise
6 duckdb:vortex-compact -3.0% -8.5% +6.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -13.1% -8.5% -5.1% +30.0% ➖ noise
7 datafusion:vortex-compact +14.0% -1.7% +16.0% +34.6% ➖ noise
7 datafusion:vortex-file-compressed -12.9% -1.7% -11.4% +30.0% ➖ noise
7 duckdb:vortex-compact +14.4% -1.7% +16.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +4.1% -1.7% +5.9% +30.0% ➖ noise
8 datafusion:vortex-compact +6.4% +0.3% +6.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -25.7% +0.3% -25.9% +30.0% ✅ faster
8 duckdb:vortex-compact +12.0% +0.3% +11.7% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.0% +0.3% +3.8% +30.0% ➖ noise
9 datafusion:vortex-compact +13.5% -6.4% +21.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -45.5% -6.4% -41.8% +37.3% ✅ faster
9 duckdb:vortex-compact +14.4% -6.4% +22.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.4% -6.4% +4.3% +30.0% ➖ noise
10 datafusion:vortex-compact +15.5% +0.3% +15.1% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -26.7% +0.3% -26.9% +32.2% ✅ faster
10 duckdb:vortex-compact -17.0% +0.3% -17.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -5.1% +0.3% -5.4% +30.0% ➖ noise
11 datafusion:vortex-compact +22.4% -8.0% +33.0% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed -0.7% -8.0% +7.9% +39.6% ➖ noise
11 duckdb:vortex-compact +1.7% -8.0% +10.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -0.4% -8.0% +8.3% +30.0% ➖ noise
12 datafusion:vortex-compact +6.6% -3.7% +10.7% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -9.3% -3.7% -5.8% +30.0% ➖ noise
12 duckdb:vortex-compact -1.4% -3.7% +2.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +1.1% -3.7% +5.0% +30.0% ➖ noise
13 datafusion:vortex-compact +19.1% +4.8% +13.7% +59.8% ➖ noise
13 datafusion:vortex-file-compressed +27.7% +4.8% +21.9% +41.2% ➖ noise
13 duckdb:vortex-compact -1.9% +4.8% -6.4% +33.6% ➖ noise
13 duckdb:vortex-file-compressed +11.2% +4.8% +6.2% +35.7% ➖ noise
14 datafusion:vortex-compact +17.1% -4.4% +22.5% +35.8% ➖ noise
14 datafusion:vortex-file-compressed +0.3% -4.4% +5.0% +31.1% ➖ noise
14 duckdb:vortex-compact +6.9% -4.4% +11.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.8% -4.4% +2.8% +30.0% ➖ noise
15 datafusion:vortex-compact -3.3% -10.2% +7.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -11.9% -10.2% -2.0% +30.0% ➖ noise
15 duckdb:vortex-compact +3.7% -10.2% +15.5% +46.0% ➖ noise
15 duckdb:vortex-file-compressed -4.7% -10.2% +6.1% +30.0% ➖ noise
16 datafusion:vortex-compact -16.7% +1.0% -17.6% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -1.4% +1.0% -2.5% +30.0% ➖ noise
16 duckdb:vortex-compact +3.8% +1.0% +2.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +2.7% +1.0% +1.6% +30.0% ➖ noise
17 datafusion:vortex-compact +1.5% +4.1% -2.5% +30.8% ➖ noise
17 datafusion:vortex-file-compressed -14.3% +4.1% -17.7% +36.1% ➖ noise
17 duckdb:vortex-compact -5.9% +4.1% -9.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -3.2% +4.1% -7.0% +30.0% ➖ noise
18 datafusion:vortex-compact +45.3% -4.0% +51.4% +30.3% 🚨 regression
18 datafusion:vortex-file-compressed -2.0% -4.0% +2.1% +30.0% ➖ noise
18 duckdb:vortex-compact -2.5% -4.0% +1.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -7.0% -4.0% -3.1% +33.0% ➖ noise
19 datafusion:vortex-compact +6.3% +3.4% +2.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +13.4% +3.4% +9.6% +30.0% ➖ noise
19 duckdb:vortex-compact +8.8% +3.4% +5.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +11.7% +3.4% +8.1% +30.0% ➖ noise
20 datafusion:vortex-compact +16.4% +26.2% -7.8% +38.6% ➖ noise
20 datafusion:vortex-file-compressed -25.6% +26.2% -41.1% +37.6% ✅ faster
20 duckdb:vortex-compact +7.1% +26.2% -15.1% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.7% +26.2% -23.7% +30.0% ✅ faster
21 datafusion:vortex-compact -17.6% +14.9% -28.2% +30.9% ✅ faster
21 datafusion:vortex-file-compressed +9.9% +14.9% -4.3% +30.0% ➖ noise
21 duckdb:vortex-compact +6.7% +14.9% -7.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -5.2% +14.9% -17.5% +30.0% ➖ noise
22 datafusion:vortex-compact -19.2% -14.6% -5.4% +63.0% ➖ noise
22 datafusion:vortex-file-compressed +37.6% -14.6% +61.1% +35.0% 🚨 regression
22 duckdb:vortex-compact +6.3% -14.6% +24.5% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -2.6% -14.6% +14.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.8%


datafusion / vortex-file-compressed (0.987x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 23861765 25553524 0.93
tpcds_q02/datafusion:vortex-file-compressed 46592089 46600987 1.00
tpcds_q03/datafusion:vortex-file-compressed 14903680 15098181 0.99
tpcds_q04/datafusion:vortex-file-compressed 247949093 256543650 0.97
tpcds_q05/datafusion:vortex-file-compressed 43102478 43040357 1.00
tpcds_q06/datafusion:vortex-file-compressed 62530956 58172077 1.07
tpcds_q07/datafusion:vortex-file-compressed 40835871 41057132 0.99
tpcds_q08/datafusion:vortex-file-compressed 28381498 28538400 0.99
tpcds_q09/datafusion:vortex-file-compressed 43693772 44376170 0.98
tpcds_q10/datafusion:vortex-file-compressed 🚨 43879998 38725105 1.13
tpcds_q11/datafusion:vortex-file-compressed 128643752 127366688 1.01
tpcds_q12/datafusion:vortex-file-compressed 19040232 19203150 0.99
tpcds_q13/datafusion:vortex-file-compressed 43171933 45782381 0.94
tpcds_q14/datafusion:vortex-file-compressed 170506331 168818048 1.01
tpcds_q15/datafusion:vortex-file-compressed 28681896 28854672 0.99
tpcds_q16/datafusion:vortex-file-compressed 29110246 29519175 0.99
tpcds_q17/datafusion:vortex-file-compressed 61528428 61711380 1.00
tpcds_q18/datafusion:vortex-file-compressed 67874014 68354912 0.99
tpcds_q19/datafusion:vortex-file-compressed 21219323 22400258 0.95
tpcds_q20/datafusion:vortex-file-compressed 21898459 21170058 1.03
tpcds_q21/datafusion:vortex-file-compressed 36717168 35962208 1.02
tpcds_q22/datafusion:vortex-file-compressed 🚀 111495363 144876703 0.77
tpcds_q23/datafusion:vortex-file-compressed 145356294 146293805 0.99
tpcds_q24/datafusion:vortex-file-compressed 81701844 84039213 0.97
tpcds_q25/datafusion:vortex-file-compressed 66037010 66058789 1.00
tpcds_q26/datafusion:vortex-file-compressed 33040167 33739083 0.98
tpcds_q27/datafusion:vortex-file-compressed 104811609 103944442 1.01
tpcds_q28/datafusion:vortex-file-compressed 40936002 43157725 0.95
tpcds_q29/datafusion:vortex-file-compressed 60654589 63591657 0.95
tpcds_q30/datafusion:vortex-file-compressed 23240212 23085442 1.01
tpcds_q31/datafusion:vortex-file-compressed 73431750 74814233 0.98
tpcds_q32/datafusion:vortex-file-compressed 20244301 20046695 1.01
tpcds_q33/datafusion:vortex-file-compressed 29344949 29210062 1.00
tpcds_q34/datafusion:vortex-file-compressed 23692560 24217061 0.98
tpcds_q35/datafusion:vortex-file-compressed 43966804 44460100 0.99
tpcds_q36/datafusion:vortex-file-compressed 56242243 56255579 1.00
tpcds_q37/datafusion:vortex-file-compressed 25157075 25034844 1.00
tpcds_q38/datafusion:vortex-file-compressed 43174759 42948221 1.01
tpcds_q39/datafusion:vortex-file-compressed 102251537 103833628 0.98
tpcds_q40/datafusion:vortex-file-compressed 33091545 32855786 1.01
tpcds_q41/datafusion:vortex-file-compressed 15536419 15164235 1.02
tpcds_q42/datafusion:vortex-file-compressed 14095758 13930621 1.01
tpcds_q43/datafusion:vortex-file-compressed 18654912 18479463 1.01
tpcds_q44/datafusion:vortex-file-compressed 30705309 32368546 0.95
tpcds_q45/datafusion:vortex-file-compressed 27110151 26503841 1.02
tpcds_q46/datafusion:vortex-file-compressed 33885567 34829133 0.97
tpcds_q47/datafusion:vortex-file-compressed 130605139 128992315 1.01
tpcds_q48/datafusion:vortex-file-compressed 37967898 40930737 0.93
tpcds_q49/datafusion:vortex-file-compressed 57347279 58452491 0.98
tpcds_q50/datafusion:vortex-file-compressed 38338496 38443409 1.00
tpcds_q51/datafusion:vortex-file-compressed 87089302 86888199 1.00
tpcds_q52/datafusion:vortex-file-compressed 14258259 13814055 1.03
tpcds_q53/datafusion:vortex-file-compressed 21011910 20808271 1.01
tpcds_q54/datafusion:vortex-file-compressed 34502183 34616837 1.00
tpcds_q55/datafusion:vortex-file-compressed 13574999 13767886 0.99
tpcds_q56/datafusion:vortex-file-compressed 29857845 29329048 1.02
tpcds_q57/datafusion:vortex-file-compressed 105750270 112126318 0.94
tpcds_q58/datafusion:vortex-file-compressed 50833040 53020880 0.96
tpcds_q59/datafusion:vortex-file-compressed 56477568 56189660 1.01
tpcds_q60/datafusion:vortex-file-compressed 28738100 29338159 0.98
tpcds_q61/datafusion:vortex-file-compressed 39584628 40324184 0.98
tpcds_q62/datafusion:vortex-file-compressed 22501183 21930120 1.03
tpcds_q63/datafusion:vortex-file-compressed 20650575 21236531 0.97
tpcds_q64/datafusion:vortex-file-compressed 407650975 410650743 0.99
tpcds_q65/datafusion:vortex-file-compressed 39717422 40143927 0.99
tpcds_q66/datafusion:vortex-file-compressed 69434741 71190402 0.98
tpcds_q67/datafusion:vortex-file-compressed 143917332 138453503 1.04
tpcds_q68/datafusion:vortex-file-compressed 31924630 32791820 0.97
tpcds_q69/datafusion:vortex-file-compressed 35612321 35628078 1.00
tpcds_q70/datafusion:vortex-file-compressed 84151090 88739581 0.95
tpcds_q71/datafusion:vortex-file-compressed 22075088 22653179 0.97
tpcds_q72/datafusion:vortex-file-compressed 2093340950 2107817350 0.99
tpcds_q73/datafusion:vortex-file-compressed 22247641 22834931 0.97
tpcds_q74/datafusion:vortex-file-compressed 76468274 79091389 0.97
tpcds_q75/datafusion:vortex-file-compressed 104810789 110320532 0.95
tpcds_q76/datafusion:vortex-file-compressed 22747893 23470418 0.97
tpcds_q77/datafusion:vortex-file-compressed 38227347 39225048 0.97
tpcds_q78/datafusion:vortex-file-compressed 121720177 124020712 0.98
tpcds_q79/datafusion:vortex-file-compressed 27658189 28762131 0.96
tpcds_q80/datafusion:vortex-file-compressed 92568646 90966721 1.02
tpcds_q81/datafusion:vortex-file-compressed 23394547 23943267 0.98
tpcds_q82/datafusion:vortex-file-compressed 25513655 26371278 0.97
tpcds_q83/datafusion:vortex-file-compressed 32183613 33607323 0.96
tpcds_q84/datafusion:vortex-file-compressed 12378370 12565169 0.99
tpcds_q85/datafusion:vortex-file-compressed 93968517 97218897 0.97
tpcds_q86/datafusion:vortex-file-compressed 15411048 15810893 0.97
tpcds_q87/datafusion:vortex-file-compressed 42962715 43416309 0.99
tpcds_q88/datafusion:vortex-file-compressed 53929826 55474677 0.97
tpcds_q89/datafusion:vortex-file-compressed 24311176 24592110 0.99
tpcds_q90/datafusion:vortex-file-compressed 15314290 14759885 1.04
tpcds_q91/datafusion:vortex-file-compressed 17986285 17713271 1.02
tpcds_q92/datafusion:vortex-file-compressed 18527834 19275472 0.96
tpcds_q93/datafusion:vortex-file-compressed 32624148 33256286 0.98
tpcds_q94/datafusion:vortex-file-compressed 23025830 25497324 0.90
tpcds_q95/datafusion:vortex-file-compressed 61832518 61294339 1.01
tpcds_q96/datafusion:vortex-file-compressed 13360539 13168891 1.01
tpcds_q97/datafusion:vortex-file-compressed 31880541 31675899 1.01
tpcds_q98/datafusion:vortex-file-compressed 24189147 24791085 0.98
tpcds_q99/datafusion:vortex-file-compressed 33070201 32293969 1.02
datafusion / vortex-compact (0.986x ➖, 2↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24838127 24617517 1.01
tpcds_q02/datafusion:vortex-compact 52233272 52756900 0.99
tpcds_q03/datafusion:vortex-compact 19498868 20088039 0.97
tpcds_q04/datafusion:vortex-compact 296708608 294854733 1.01
tpcds_q05/datafusion:vortex-compact 46315292 47451742 0.98
tpcds_q06/datafusion:vortex-compact 63788375 61286325 1.04
tpcds_q07/datafusion:vortex-compact 55179075 54156505 1.02
tpcds_q08/datafusion:vortex-compact 35015349 35188192 1.00
tpcds_q09/datafusion:vortex-compact 61987596 63475844 0.98
tpcds_q10/datafusion:vortex-compact 49823527 49726561 1.00
tpcds_q11/datafusion:vortex-compact 146557854 147654790 0.99
tpcds_q12/datafusion:vortex-compact 🚀 22406358 25454426 0.88
tpcds_q13/datafusion:vortex-compact 93562305 94140223 0.99
tpcds_q14/datafusion:vortex-compact 194282866 193782889 1.00
tpcds_q15/datafusion:vortex-compact 29715150 30911500 0.96
tpcds_q16/datafusion:vortex-compact 32259458 32504671 0.99
tpcds_q17/datafusion:vortex-compact 71803260 75530888 0.95
tpcds_q18/datafusion:vortex-compact 76585418 76296920 1.00
tpcds_q19/datafusion:vortex-compact 28617618 29528266 0.97
tpcds_q20/datafusion:vortex-compact 25524398 25402786 1.00
tpcds_q21/datafusion:vortex-compact 39681075 41614124 0.95
tpcds_q22/datafusion:vortex-compact 116436537 125930363 0.92
tpcds_q23/datafusion:vortex-compact 167873799 165613757 1.01
tpcds_q24/datafusion:vortex-compact 95091402 95496577 1.00
tpcds_q25/datafusion:vortex-compact 77801562 78718900 0.99
tpcds_q26/datafusion:vortex-compact 43750317 46954740 0.93
tpcds_q27/datafusion:vortex-compact 122486756 127271987 0.96
tpcds_q28/datafusion:vortex-compact 79572902 81919973 0.97
tpcds_q29/datafusion:vortex-compact 72204322 71613684 1.01
tpcds_q30/datafusion:vortex-compact 28633367 27657857 1.04
tpcds_q31/datafusion:vortex-compact 95821059 98039591 0.98
tpcds_q32/datafusion:vortex-compact 24764044 25345564 0.98
tpcds_q33/datafusion:vortex-compact 35304279 35861731 0.98
tpcds_q34/datafusion:vortex-compact 31751653 31923017 0.99
tpcds_q35/datafusion:vortex-compact 51191640 52025517 0.98
tpcds_q36/datafusion:vortex-compact 73153431 75779902 0.97
tpcds_q37/datafusion:vortex-compact 41385132 39562550 1.05
tpcds_q38/datafusion:vortex-compact 52894586 51632876 1.02
tpcds_q39/datafusion:vortex-compact 105517321 110573320 0.95
tpcds_q40/datafusion:vortex-compact 36730083 36193682 1.01
tpcds_q41/datafusion:vortex-compact 17361739 17444810 1.00
tpcds_q42/datafusion:vortex-compact 18144500 18333391 0.99
tpcds_q43/datafusion:vortex-compact 24183485 24583738 0.98
tpcds_q44/datafusion:vortex-compact 44859183 48242162 0.93
tpcds_q45/datafusion:vortex-compact 30161152 30888681 0.98
tpcds_q46/datafusion:vortex-compact 43469580 44077248 0.99
tpcds_q47/datafusion:vortex-compact 150742838 148744574 1.01
tpcds_q48/datafusion:vortex-compact 69236108 72038506 0.96
tpcds_q49/datafusion:vortex-compact 68319802 74250774 0.92
tpcds_q50/datafusion:vortex-compact 46983228 47967502 0.98
tpcds_q51/datafusion:vortex-compact 95890449 95781950 1.00
tpcds_q52/datafusion:vortex-compact 18391154 19796338 0.93
tpcds_q53/datafusion:vortex-compact 28693288 28810647 1.00
tpcds_q54/datafusion:vortex-compact 40908364 40991387 1.00
tpcds_q55/datafusion:vortex-compact 17774612 18178216 0.98
tpcds_q56/datafusion:vortex-compact 34520444 35727159 0.97
tpcds_q57/datafusion:vortex-compact 116311591 116447334 1.00
tpcds_q58/datafusion:vortex-compact 62913036 63416697 0.99
tpcds_q59/datafusion:vortex-compact 69174356 69306033 1.00
tpcds_q60/datafusion:vortex-compact 36302380 34778743 1.04
tpcds_q61/datafusion:vortex-compact 54519155 53285098 1.02
tpcds_q62/datafusion:vortex-compact 🚀 24249198 27933480 0.87
tpcds_q63/datafusion:vortex-compact 27637680 27746589 1.00
tpcds_q64/datafusion:vortex-compact 446512350 446151733 1.00
tpcds_q65/datafusion:vortex-compact 56488487 55498316 1.02
tpcds_q66/datafusion:vortex-compact 77040223 74234554 1.04
tpcds_q67/datafusion:vortex-compact 148139604 157625929 0.94
tpcds_q68/datafusion:vortex-compact 44036176 44414196 0.99
tpcds_q69/datafusion:vortex-compact 47156467 47778574 0.99
tpcds_q70/datafusion:vortex-compact 97404848 96986285 1.00
tpcds_q71/datafusion:vortex-compact 29862452 29649266 1.01
tpcds_q72/datafusion:vortex-compact 2101393237 2111007024 1.00
tpcds_q73/datafusion:vortex-compact 30641697 31078268 0.99
tpcds_q74/datafusion:vortex-compact 89797329 89086764 1.01
tpcds_q75/datafusion:vortex-compact 126488553 131002620 0.97
tpcds_q76/datafusion:vortex-compact 31790302 31350187 1.01
tpcds_q77/datafusion:vortex-compact 48304640 50579682 0.96
tpcds_q78/datafusion:vortex-compact 135844664 137402297 0.99
tpcds_q79/datafusion:vortex-compact 37941195 38430336 0.99
tpcds_q80/datafusion:vortex-compact 101975527 103667157 0.98
tpcds_q81/datafusion:vortex-compact 28984636 27259471 1.06
tpcds_q82/datafusion:vortex-compact 39958060 40526170 0.99
tpcds_q83/datafusion:vortex-compact 32445600 32787118 0.99
tpcds_q84/datafusion:vortex-compact 14132700 14963127 0.94
tpcds_q85/datafusion:vortex-compact 129055232 132824821 0.97
tpcds_q86/datafusion:vortex-compact 20561807 21880470 0.94
tpcds_q87/datafusion:vortex-compact 49774392 52704260 0.94
tpcds_q88/datafusion:vortex-compact 75375597 75888725 0.99
tpcds_q89/datafusion:vortex-compact 30211212 30349145 1.00
tpcds_q90/datafusion:vortex-compact 15266565 14945522 1.02
tpcds_q91/datafusion:vortex-compact 31540024 32491854 0.97
tpcds_q92/datafusion:vortex-compact 23683665 24650360 0.96
tpcds_q93/datafusion:vortex-compact 36828079 38043275 0.97
tpcds_q94/datafusion:vortex-compact 🚨 28834052 25946573 1.11
tpcds_q95/datafusion:vortex-compact 66660547 65476947 1.02
tpcds_q96/datafusion:vortex-compact 17047126 17261178 0.99
tpcds_q97/datafusion:vortex-compact 36727245 36809535 1.00
tpcds_q98/datafusion:vortex-compact 29316904 29728168 0.99
tpcds_q99/datafusion:vortex-compact 30488459 30583701 1.00
datafusion / parquet (0.995x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30868742 29664760 1.04
tpcds_q02/datafusion:parquet 40813139 40801370 1.00
tpcds_q03/datafusion:parquet 12868347 12624283 1.02
tpcds_q04/datafusion:parquet 269841137 262383323 1.03
tpcds_q05/datafusion:parquet 39495830 40602464 0.97
tpcds_q06/datafusion:parquet 57854121 59076288 0.98
tpcds_q07/datafusion:parquet 75555643 77395453 0.98
tpcds_q08/datafusion:parquet 25891960 25059004 1.03
tpcds_q09/datafusion:parquet 45346400 42687645 1.06
tpcds_q10/datafusion:parquet 70157676 65865088 1.07
tpcds_q11/datafusion:parquet 146482628 146979768 1.00
tpcds_q12/datafusion:parquet 17673553 16666666 1.06
tpcds_q13/datafusion:parquet 73591359 73526440 1.00
tpcds_q14/datafusion:parquet 157229474 156852677 1.00
tpcds_q15/datafusion:parquet 20404761 20832040 0.98
tpcds_q16/datafusion:parquet 22956181 22577519 1.02
tpcds_q17/datafusion:parquet 60202085 62736423 0.96
tpcds_q18/datafusion:parquet 110679220 119666221 0.92
tpcds_q19/datafusion:parquet 22200936 21862137 1.02
tpcds_q20/datafusion:parquet 16060495 16064674 1.00
tpcds_q21/datafusion:parquet 17931371 18078370 0.99
tpcds_q22/datafusion:parquet 152055529 146261081 1.04
tpcds_q23/datafusion:parquet 144179043 141752365 1.02
tpcds_q24/datafusion:parquet 87823112 87519160 1.00
tpcds_q25/datafusion:parquet 62753709 64355794 0.98
tpcds_q26/datafusion:parquet 64191955 65048381 0.99
tpcds_q27/datafusion:parquet 140753745 140299162 1.00
tpcds_q28/datafusion:parquet 44230026 43991267 1.01
tpcds_q29/datafusion:parquet 64112676 64120289 1.00
tpcds_q30/datafusion:parquet 32988355 33345675 0.99
tpcds_q31/datafusion:parquet 63085321 63642117 0.99
tpcds_q32/datafusion:parquet 17319587 17298107 1.00
tpcds_q33/datafusion:parquet 25701576 26630838 0.97
tpcds_q34/datafusion:parquet 19458556 21160632 0.92
tpcds_q35/datafusion:parquet 65267529 67733494 0.96
tpcds_q36/datafusion:parquet 55377798 54860516 1.01
tpcds_q37/datafusion:parquet 18776617 18334362 1.02
tpcds_q38/datafusion:parquet 38765004 39890215 0.97
tpcds_q39/datafusion:parquet 71030402 71617035 0.99
tpcds_q40/datafusion:parquet 23618024 23013108 1.03
tpcds_q41/datafusion:parquet 13157903 13035145 1.01
tpcds_q42/datafusion:parquet 11085796 11198664 0.99
tpcds_q43/datafusion:parquet 16418192 16710489 0.98
tpcds_q44/datafusion:parquet 32211352 34006717 0.95
tpcds_q45/datafusion:parquet 28044271 27705547 1.01
tpcds_q46/datafusion:parquet 30933160 31438184 0.98
tpcds_q47/datafusion:parquet 122286907 122230147 1.00
tpcds_q48/datafusion:parquet 67014248 68869798 0.97
tpcds_q49/datafusion:parquet 53855465 54447510 0.99
tpcds_q50/datafusion:parquet 44041416 42508307 1.04
tpcds_q51/datafusion:parquet 83058813 83957944 0.99
tpcds_q52/datafusion:parquet 🚀 11435779 12725089 0.90
tpcds_q53/datafusion:parquet 17385303 16970454 1.02
tpcds_q54/datafusion:parquet 32810733 33139089 0.99
tpcds_q55/datafusion:parquet 11328540 10665659 1.06
tpcds_q56/datafusion:parquet 25952645 26614563 0.98
tpcds_q57/datafusion:parquet 95805099 99977947 0.96
tpcds_q58/datafusion:parquet 49232366 47936190 1.03
tpcds_q59/datafusion:parquet 56802637 56183867 1.01
tpcds_q60/datafusion:parquet 26171398 27291777 0.96
tpcds_q61/datafusion:parquet 41989639 41572395 1.01
tpcds_q62/datafusion:parquet 25644716 24336643 1.05
tpcds_q63/datafusion:parquet 17302753 17351029 1.00
tpcds_q64/datafusion:parquet 510422820 507358694 1.01
tpcds_q65/datafusion:parquet 37189824 36774956 1.01
tpcds_q66/datafusion:parquet 71346541 69234398 1.03
tpcds_q67/datafusion:parquet 141569220 139534486 1.01
tpcds_q68/datafusion:parquet 31268924 31717234 0.99
tpcds_q69/datafusion:parquet 64508972 64046541 1.01
tpcds_q70/datafusion:parquet 83483799 87092455 0.96
tpcds_q71/datafusion:parquet 21889495 21897720 1.00
tpcds_q72/datafusion:parquet 592428106 594528446 1.00
tpcds_q73/datafusion:parquet 19950976 20458592 0.98
tpcds_q74/datafusion:parquet 78904252 79255582 1.00
tpcds_q75/datafusion:parquet 96692267 95555057 1.01
tpcds_q76/datafusion:parquet 28472657 28872767 0.99
tpcds_q77/datafusion:parquet 37986663 37744103 1.01
tpcds_q78/datafusion:parquet 113397523 110291437 1.03
tpcds_q79/datafusion:parquet 25526040 26159955 0.98
tpcds_q80/datafusion:parquet 77480795 76878595 1.01
tpcds_q81/datafusion:parquet 30297123 30938838 0.98
tpcds_q82/datafusion:parquet 18803119 18607048 1.01
tpcds_q83/datafusion:parquet 35071796 35980858 0.97
tpcds_q84/datafusion:parquet 37499571 38592559 0.97
tpcds_q85/datafusion:parquet 146101819 147751256 0.99
tpcds_q86/datafusion:parquet 13499627 14524869 0.93
tpcds_q87/datafusion:parquet 39420896 39878138 0.99
tpcds_q88/datafusion:parquet 59407050 57877981 1.03
tpcds_q89/datafusion:parquet 21129955 20345963 1.04
tpcds_q90/datafusion:parquet 13792406 14048467 0.98
tpcds_q91/datafusion:parquet 55396352 57106724 0.97
tpcds_q92/datafusion:parquet 17774860 17295389 1.03
tpcds_q93/datafusion:parquet 30529369 30939423 0.99
tpcds_q94/datafusion:parquet 20195287 19251692 1.05
tpcds_q95/datafusion:parquet 58301856 58453288 1.00
tpcds_q96/datafusion:parquet 11284674 11488075 0.98
tpcds_q97/datafusion:parquet 29111358 29828805 0.98
tpcds_q98/datafusion:parquet 20523086 21171319 0.97
tpcds_q99/datafusion:parquet 🚀 28636272 33268520 0.86
duckdb / vortex-file-compressed (0.990x ➖, 0↑ 2↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21249308 21716720 0.98
tpcds_q02/duckdb:vortex-file-compressed 33792438 36758783 0.92
tpcds_q03/duckdb:vortex-file-compressed 32406365 30682555 1.06
tpcds_q04/duckdb:vortex-file-compressed 101788083 108500750 0.94
tpcds_q05/duckdb:vortex-file-compressed 36711711 35550650 1.03
tpcds_q06/duckdb:vortex-file-compressed 30974149 31521727 0.98
tpcds_q07/duckdb:vortex-file-compressed 18742591 19787470 0.95
tpcds_q08/duckdb:vortex-file-compressed 27783038 28122810 0.99
tpcds_q09/duckdb:vortex-file-compressed 36601569 37833242 0.97
tpcds_q10/duckdb:vortex-file-compressed 39749146 40563220 0.98
tpcds_q11/duckdb:vortex-file-compressed 60144712 61736894 0.97
tpcds_q12/duckdb:vortex-file-compressed 13797324 14175403 0.97
tpcds_q13/duckdb:vortex-file-compressed 32585805 33452972 0.97
tpcds_q14/duckdb:vortex-file-compressed 104239230 106017881 0.98
tpcds_q15/duckdb:vortex-file-compressed 25870476 26816388 0.96
tpcds_q16/duckdb:vortex-file-compressed 26323829 26645152 0.99
tpcds_q17/duckdb:vortex-file-compressed 42653635 42742010 1.00
tpcds_q18/duckdb:vortex-file-compressed 44934596 47679069 0.94
tpcds_q19/duckdb:vortex-file-compressed 32776293 32763546 1.00
tpcds_q20/duckdb:vortex-file-compressed 15329264 15063541 1.02
tpcds_q21/duckdb:vortex-file-compressed 16219999 17053140 0.95
tpcds_q22/duckdb:vortex-file-compressed 71315503 71831529 0.99
tpcds_q23/duckdb:vortex-file-compressed 108150902 108946467 0.99
tpcds_q24/duckdb:vortex-file-compressed 51145051 50935365 1.00
tpcds_q25/duckdb:vortex-file-compressed 49501940 48116172 1.03
tpcds_q26/duckdb:vortex-file-compressed 37959126 40191824 0.94
tpcds_q27/duckdb:vortex-file-compressed 46108052 50300558 0.92
tpcds_q28/duckdb:vortex-file-compressed 34110984 34249878 1.00
tpcds_q29/duckdb:vortex-file-compressed 41526906 41300366 1.01
tpcds_q30/duckdb:vortex-file-compressed 23405071 23587249 0.99
tpcds_q31/duckdb:vortex-file-compressed 35297646 36163830 0.98
tpcds_q32/duckdb:vortex-file-compressed 13598590 14543250 0.94
tpcds_q33/duckdb:vortex-file-compressed 23373196 23822384 0.98
tpcds_q34/duckdb:vortex-file-compressed 23189538 22663459 1.02
tpcds_q35/duckdb:vortex-file-compressed 64449219 63853315 1.01
tpcds_q36/duckdb:vortex-file-compressed 24631085 24508268 1.01
tpcds_q37/duckdb:vortex-file-compressed 14703852 15740929 0.93
tpcds_q38/duckdb:vortex-file-compressed 37505053 36378515 1.03
tpcds_q39/duckdb:vortex-file-compressed 34715331 35048222 0.99
tpcds_q40/duckdb:vortex-file-compressed 20099327 19602130 1.03
tpcds_q41/duckdb:vortex-file-compressed 12789076 12876846 0.99
tpcds_q42/duckdb:vortex-file-compressed 12747868 13024560 0.98
tpcds_q43/duckdb:vortex-file-compressed 22796994 23245782 0.98
tpcds_q44/duckdb:vortex-file-compressed 20896006 20738325 1.01
tpcds_q45/duckdb:vortex-file-compressed 28679240 29293481 0.98
tpcds_q46/duckdb:vortex-file-compressed 50824903 51199383 0.99
tpcds_q47/duckdb:vortex-file-compressed 44776249 46932490 0.95
tpcds_q48/duckdb:vortex-file-compressed 29701013 29885878 0.99
tpcds_q49/duckdb:vortex-file-compressed 🚨 37417686 32998191 1.13
tpcds_q50/duckdb:vortex-file-compressed 33532867 33012126 1.02
tpcds_q51/duckdb:vortex-file-compressed 94923112 97604979 0.97
tpcds_q52/duckdb:vortex-file-compressed 12951637 12450905 1.04
tpcds_q53/duckdb:vortex-file-compressed 22507531 21951614 1.03
tpcds_q54/duckdb:vortex-file-compressed 27462159 28304218 0.97
tpcds_q55/duckdb:vortex-file-compressed 13105281 13091663 1.00
tpcds_q56/duckdb:vortex-file-compressed 23399962 23812380 0.98
tpcds_q57/duckdb:vortex-file-compressed 39150925 39534732 0.99
tpcds_q58/duckdb:vortex-file-compressed 31373381 30715897 1.02
tpcds_q59/duckdb:vortex-file-compressed 67843840 66783555 1.02
tpcds_q60/duckdb:vortex-file-compressed 25503530 25487588 1.00
tpcds_q61/duckdb:vortex-file-compressed 🚨 34363487 29885194 1.15
tpcds_q62/duckdb:vortex-file-compressed 17628028 16898514 1.04
tpcds_q63/duckdb:vortex-file-compressed 21236789 21133824 1.00
tpcds_q64/duckdb:vortex-file-compressed 79188273 84069216 0.94
tpcds_q65/duckdb:vortex-file-compressed 21501360 20997290 1.02
tpcds_q66/duckdb:vortex-file-compressed 28841040 28771748 1.00
tpcds_q67/duckdb:vortex-file-compressed 135145940 137442440 0.98
tpcds_q68/duckdb:vortex-file-compressed 39738178 41563526 0.96
tpcds_q69/duckdb:vortex-file-compressed 41754790 40771019 1.02
tpcds_q70/duckdb:vortex-file-compressed 24726384 26157865 0.95
tpcds_q71/duckdb:vortex-file-compressed 21551140 20277906 1.06
tpcds_q72/duckdb:vortex-file-compressed 173294104 173054815 1.00
tpcds_q73/duckdb:vortex-file-compressed 23484979 22634253 1.04
tpcds_q74/duckdb:vortex-file-compressed 71265139 78546799 0.91
tpcds_q75/duckdb:vortex-file-compressed 59053179 57791067 1.02
tpcds_q76/duckdb:vortex-file-compressed 18385997 20262721 0.91
tpcds_q77/duckdb:vortex-file-compressed 24960768 24710411 1.01
tpcds_q78/duckdb:vortex-file-compressed 75688651 77047865 0.98
tpcds_q79/duckdb:vortex-file-compressed 32114222 32377764 0.99
tpcds_q80/duckdb:vortex-file-compressed 43908702 48383066 0.91
tpcds_q81/duckdb:vortex-file-compressed 27199495 28123689 0.97
tpcds_q82/duckdb:vortex-file-compressed 16430670 16556155 0.99
tpcds_q83/duckdb:vortex-file-compressed 22642437 23257215 0.97
tpcds_q84/duckdb:vortex-file-compressed 18436503 19587100 0.94
tpcds_q85/duckdb:vortex-file-compressed 45118793 43035728 1.05
tpcds_q86/duckdb:vortex-file-compressed 16188449 16281290 0.99
tpcds_q87/duckdb:vortex-file-compressed 39481524 41858364 0.94
tpcds_q88/duckdb:vortex-file-compressed 32671036 33556285 0.97
tpcds_q89/duckdb:vortex-file-compressed 21861196 22209368 0.98
tpcds_q90/duckdb:vortex-file-compressed 12139817 12623414 0.96
tpcds_q91/duckdb:vortex-file-compressed 30586827 30097350 1.02
tpcds_q92/duckdb:vortex-file-compressed 21505842 20127423 1.07
tpcds_q93/duckdb:vortex-file-compressed 26939495 27408864 0.98
tpcds_q94/duckdb:vortex-file-compressed 23842752 23568010 1.01
tpcds_q95/duckdb:vortex-file-compressed 143019266 142875533 1.00
tpcds_q96/duckdb:vortex-file-compressed 12963976 13901181 0.93
tpcds_q97/duckdb:vortex-file-compressed 38173197 36997119 1.03
tpcds_q98/duckdb:vortex-file-compressed 17823224 17319547 1.03
tpcds_q99/duckdb:vortex-file-compressed 26849846 27159491 0.99
duckdb / vortex-compact (0.995x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23435099 23925045 0.98
tpcds_q02/duckdb:vortex-compact 42508620 42217207 1.01
tpcds_q03/duckdb:vortex-compact 56624474 56771634 1.00
tpcds_q04/duckdb:vortex-compact 118621230 112405601 1.06
tpcds_q05/duckdb:vortex-compact 51462446 53440732 0.96
tpcds_q06/duckdb:vortex-compact 39545704 41974426 0.94
tpcds_q07/duckdb:vortex-compact 34703303 34235803 1.01
tpcds_q08/duckdb:vortex-compact 45473603 44102466 1.03
tpcds_q09/duckdb:vortex-compact 56813310 58578818 0.97
tpcds_q10/duckdb:vortex-compact 62810206 59979592 1.05
tpcds_q11/duckdb:vortex-compact 71082057 69912702 1.02
tpcds_q12/duckdb:vortex-compact 21697325 22131370 0.98
tpcds_q13/duckdb:vortex-compact 60316934 57730021 1.04
tpcds_q14/duckdb:vortex-compact 128359225 127899852 1.00
tpcds_q15/duckdb:vortex-compact 30781900 30954457 0.99
tpcds_q16/duckdb:vortex-compact 30313191 30434785 1.00
tpcds_q17/duckdb:vortex-compact 51968293 54703078 0.95
tpcds_q18/duckdb:vortex-compact 57623908 56180924 1.03
tpcds_q19/duckdb:vortex-compact 50726140 50311694 1.01
tpcds_q20/duckdb:vortex-compact 19127485 20331499 0.94
tpcds_q21/duckdb:vortex-compact 19516302 18758068 1.04
tpcds_q22/duckdb:vortex-compact 73089969 78412566 0.93
tpcds_q23/duckdb:vortex-compact 119418008 119762629 1.00
tpcds_q24/duckdb:vortex-compact 61301771 62653485 0.98
tpcds_q25/duckdb:vortex-compact 81740300 80942482 1.01
tpcds_q26/duckdb:vortex-compact 50783699 51080577 0.99
tpcds_q27/duckdb:vortex-compact 67768964 69570120 0.97
tpcds_q28/duckdb:vortex-compact 83492061 83958051 0.99
tpcds_q29/duckdb:vortex-compact 53394095 54378143 0.98
tpcds_q30/duckdb:vortex-compact 28363715 27828704 1.02
tpcds_q31/duckdb:vortex-compact 44798070 43800033 1.02
tpcds_q32/duckdb:vortex-compact 22013615 22740733 0.97
tpcds_q33/duckdb:vortex-compact 34643820 35243028 0.98
tpcds_q34/duckdb:vortex-compact 37321154 36318120 1.03
tpcds_q35/duckdb:vortex-compact 81803093 81827018 1.00
tpcds_q36/duckdb:vortex-compact 40575836 40226710 1.01
tpcds_q37/duckdb:vortex-compact 23197030 23092254 1.00
tpcds_q38/duckdb:vortex-compact 47814012 46480620 1.03
tpcds_q39/duckdb:vortex-compact 36379644 36512112 1.00
tpcds_q40/duckdb:vortex-compact 25607328 24664415 1.04
tpcds_q41/duckdb:vortex-compact 15165800 15348923 0.99
tpcds_q42/duckdb:vortex-compact 21763348 21824973 1.00
tpcds_q43/duckdb:vortex-compact 35460784 35623690 1.00
tpcds_q44/duckdb:vortex-compact 29272561 28831248 1.02
tpcds_q45/duckdb:vortex-compact 37133779 37605991 0.99
tpcds_q46/duckdb:vortex-compact 72548505 69064115 1.05
tpcds_q47/duckdb:vortex-compact 62044713 62025892 1.00
tpcds_q48/duckdb:vortex-compact 50306009 52840265 0.95
tpcds_q49/duckdb:vortex-compact 53949757 57861751 0.93
tpcds_q50/duckdb:vortex-compact 47381704 46887883 1.01
tpcds_q51/duckdb:vortex-compact 104059444 106811968 0.97
tpcds_q52/duckdb:vortex-compact 21457717 21789208 0.98
tpcds_q53/duckdb:vortex-compact 38147573 37260504 1.02
tpcds_q54/duckdb:vortex-compact 36944821 39866386 0.93
tpcds_q55/duckdb:vortex-compact 21617139 23410594 0.92
tpcds_q56/duckdb:vortex-compact 34876057 35478154 0.98
tpcds_q57/duckdb:vortex-compact 43322799 42568432 1.02
tpcds_q58/duckdb:vortex-compact 43035024 43037724 1.00
tpcds_q59/duckdb:vortex-compact 86679149 85987451 1.01
tpcds_q60/duckdb:vortex-compact 37649472 36619209 1.03
tpcds_q61/duckdb:vortex-compact 65396173 64132115 1.02
tpcds_q62/duckdb:vortex-compact 27208989 25785517 1.06
tpcds_q63/duckdb:vortex-compact 37148227 35914596 1.03
tpcds_q64/duckdb:vortex-compact 112154220 116314029 0.96
tpcds_q65/duckdb:vortex-compact 32623194 33026036 0.99
tpcds_q66/duckdb:vortex-compact 🚀 37484863 42469891 0.88
tpcds_q67/duckdb:vortex-compact 152530685 153345982 0.99
tpcds_q68/duckdb:vortex-compact 59537989 60626569 0.98
tpcds_q69/duckdb:vortex-compact 60327790 61195449 0.99
tpcds_q70/duckdb:vortex-compact 35086237 35915380 0.98
tpcds_q71/duckdb:vortex-compact 34052664 33918146 1.00
tpcds_q72/duckdb:vortex-compact 190175552 192596668 0.99
tpcds_q73/duckdb:vortex-compact 37365457 36530174 1.02
tpcds_q74/duckdb:vortex-compact 82147095 81942058 1.00
tpcds_q75/duckdb:vortex-compact 72101445 69732374 1.03
tpcds_q76/duckdb:vortex-compact 34035166 35756020 0.95
tpcds_q77/duckdb:vortex-compact 42980218 40113789 1.07
tpcds_q78/duckdb:vortex-compact 87525799 89303644 0.98
tpcds_q79/duckdb:vortex-compact 52800743 53413189 0.99
tpcds_q80/duckdb:vortex-compact 79639319 81272183 0.98
tpcds_q81/duckdb:vortex-compact 31990152 34352555 0.93
tpcds_q82/duckdb:vortex-compact 🚀 23772938 26629475 0.89
tpcds_q83/duckdb:vortex-compact 33228919 33366488 1.00
tpcds_q84/duckdb:vortex-compact 26626625 26371370 1.01
tpcds_q85/duckdb:vortex-compact 55809025 60970462 0.92
tpcds_q86/duckdb:vortex-compact 22621162 23394651 0.97
tpcds_q87/duckdb:vortex-compact 52840689 50476248 1.05
tpcds_q88/duckdb:vortex-compact 38794571 40124130 0.97
tpcds_q89/duckdb:vortex-compact 36247015 36823654 0.98
tpcds_q90/duckdb:vortex-compact 14826214 15163218 0.98
tpcds_q91/duckdb:vortex-compact 50782018 49308513 1.03
tpcds_q92/duckdb:vortex-compact 48912524 53066642 0.92
tpcds_q93/duckdb:vortex-compact 30993391 31126547 1.00
tpcds_q94/duckdb:vortex-compact 31456969 29539497 1.06
tpcds_q95/duckdb:vortex-compact 150020682 145195248 1.03
tpcds_q96/duckdb:vortex-compact 18520904 18121949 1.02
tpcds_q97/duckdb:vortex-compact 45818703 44552305 1.03
tpcds_q98/duckdb:vortex-compact 28334706 28064987 1.01
tpcds_q99/duckdb:vortex-compact 33413127 30647000 1.09
duckdb / parquet (1.002x ➖, 1↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 31327584 27746890 1.13
tpcds_q02/duckdb:parquet 23861270 23652637 1.01
tpcds_q03/duckdb:parquet 10932550 11021228 0.99
tpcds_q04/duckdb:parquet 163232472 168623319 0.97
tpcds_q05/duckdb:parquet 29946100 28414288 1.05
tpcds_q06/duckdb:parquet 26955855 28439660 0.95
tpcds_q07/duckdb:parquet 20803103 20465716 1.02
tpcds_q08/duckdb:parquet 26212280 26148991 1.00
tpcds_q09/duckdb:parquet 38801189 39187605 0.99
tpcds_q10/duckdb:parquet 33277500 32730492 1.02
tpcds_q11/duckdb:parquet 83773302 86735498 0.97
tpcds_q12/duckdb:parquet 14497038 14149603 1.02
tpcds_q13/duckdb:parquet 33004864 32565745 1.01
tpcds_q14/duckdb:parquet 98355015 97211948 1.01
tpcds_q15/duckdb:parquet 29439294 30094539 0.98
tpcds_q16/duckdb:parquet 20933286 21678339 0.97
tpcds_q17/duckdb:parquet 37646403 38544658 0.98
tpcds_q18/duckdb:parquet 45094356 45944055 0.98
tpcds_q19/duckdb:parquet 27901343 28854661 0.97
tpcds_q20/duckdb:parquet 15222025 15419179 0.99
tpcds_q21/duckdb:parquet 10074267 10110578 1.00
tpcds_q22/duckdb:parquet 69284892 66245209 1.05
tpcds_q23/duckdb:parquet 82579246 80037232 1.03
tpcds_q24/duckdb:parquet 44398139 44174280 1.01
tpcds_q25/duckdb:parquet 32481192 32031761 1.01
tpcds_q26/duckdb:parquet 35885502 35035275 1.02
tpcds_q27/duckdb:parquet 47493633 48179166 0.99
tpcds_q28/duckdb:parquet 37101659 37733152 0.98
tpcds_q29/duckdb:parquet 35793247 35280466 1.01
tpcds_q30/duckdb:parquet 33469028 33834952 0.99
tpcds_q31/duckdb:parquet 22483736 22841711 0.98
tpcds_q32/duckdb:parquet 11116467 10790365 1.03
tpcds_q33/duckdb:parquet 20604630 20792489 0.99
tpcds_q34/duckdb:parquet 19908307 19933137 1.00
tpcds_q35/duckdb:parquet 56300543 57672933 0.98
tpcds_q36/duckdb:parquet 19328186 19360139 1.00
tpcds_q37/duckdb:parquet 12177313 11896450 1.02
tpcds_q38/duckdb:parquet 34122300 33434779 1.02
tpcds_q39/duckdb:parquet 28859366 28899169 1.00
tpcds_q40/duckdb:parquet 17287541 17755925 0.97
tpcds_q41/duckdb:parquet 7617098 7658013 0.99
tpcds_q42/duckdb:parquet 9375605 8984586 1.04
tpcds_q43/duckdb:parquet 14998227 15093120 0.99
tpcds_q44/duckdb:parquet 21730370 22047770 0.99
tpcds_q45/duckdb:parquet 25198494 26150985 0.96
tpcds_q46/duckdb:parquet 43037517 43572405 0.99
tpcds_q47/duckdb:parquet 43517383 44842899 0.97
tpcds_q48/duckdb:parquet 28768161 29046519 0.99
tpcds_q49/duckdb:parquet 24997813 24393344 1.02
tpcds_q50/duckdb:parquet 23723455 23846463 0.99
tpcds_q51/duckdb:parquet 92925561 94259570 0.99
tpcds_q52/duckdb:parquet 10157402 11045738 0.92
tpcds_q53/duckdb:parquet 14760431 14948541 0.99
tpcds_q54/duckdb:parquet 23719733 25562553 0.93
tpcds_q55/duckdb:parquet 9612461 9899184 0.97
tpcds_q56/duckdb:parquet 20911189 20664865 1.01
tpcds_q57/duckdb:parquet 34278417 35624022 0.96
tpcds_q58/duckdb:parquet 21324486 22289001 0.96
tpcds_q59/duckdb:parquet 35230383 35059690 1.00
tpcds_q60/duckdb:parquet 22238939 21234450 1.05
tpcds_q61/duckdb:parquet 29765340 31303338 0.95
tpcds_q62/duckdb:parquet 🚨 12671655 11281742 1.12
tpcds_q63/duckdb:parquet 13676304 13854369 0.99
tpcds_q64/duckdb:parquet 73328764 73888911 0.99
tpcds_q65/duckdb:parquet 19276353 19212929 1.00
tpcds_q66/duckdb:parquet 32052687 30176655 1.06
tpcds_q67/duckdb:parquet 134177334 131921125 1.02
tpcds_q68/duckdb:parquet 35068724 36484601 0.96
tpcds_q69/duckdb:parquet 35184534 35795183 0.98
tpcds_q70/duckdb:parquet 18837096 18906478 1.00
tpcds_q71/duckdb:parquet 19231033 18838860 1.02
tpcds_q72/duckdb:parquet 163590027 164086072 1.00
tpcds_q73/duckdb:parquet 17442366 17169024 1.02
tpcds_q74/duckdb:parquet 125252633 124439349 1.01
tpcds_q75/duckdb:parquet 53020070 51877237 1.02
tpcds_q76/duckdb:parquet 19750226 19243838 1.03
tpcds_q77/duckdb:parquet 21471266 21285778 1.01
tpcds_q78/duckdb:parquet 72582692 71953988 1.01
tpcds_q79/duckdb:parquet 27076878 25850001 1.05
tpcds_q80/duckdb:parquet 39387392 39491453 1.00
tpcds_q81/duckdb:parquet 31334832 31837019 0.98
tpcds_q82/duckdb:parquet 13842410 12772507 1.08
tpcds_q83/duckdb:parquet 16235554 16254817 1.00
tpcds_q84/duckdb:parquet 18394633 18654247 0.99
tpcds_q85/duckdb:parquet 37471609 36867600 1.02
tpcds_q86/duckdb:parquet 12060618 11770960 1.02
tpcds_q87/duckdb:parquet 37500051 35394551 1.06
tpcds_q88/duckdb:parquet 48348049 47562689 1.02
tpcds_q89/duckdb:parquet 16141908 15795663 1.02
tpcds_q90/duckdb:parquet 7040219 7173702 0.98
tpcds_q91/duckdb:parquet 23441264 22235271 1.05
tpcds_q92/duckdb:parquet 10937169 10683104 1.02
tpcds_q93/duckdb:parquet 28612658 29236215 0.98
tpcds_q94/duckdb:parquet 16260056 16114054 1.01
tpcds_q95/duckdb:parquet 🚨 138477660 116806171 1.19
tpcds_q96/duckdb:parquet 🚀 8214169 9152447 0.90
tpcds_q97/duckdb:parquet 32837160 33601516 0.98
tpcds_q98/duckdb:parquet 17212171 17665439 0.97
tpcds_q99/duckdb:parquet 19757040 20225414 0.98
duckdb / duckdb (0.999x ➖, 1↑ 3↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20312869 20213803 1.00
tpcds_q02/duckdb:duckdb 18628884 18800873 0.99
tpcds_q03/duckdb:duckdb 8500450 8600394 0.99
tpcds_q04/duckdb:duckdb 169688593 177989449 0.95
tpcds_q05/duckdb:duckdb 19038885 19504902 0.98
tpcds_q06/duckdb:duckdb 21990554 22889233 0.96
tpcds_q07/duckdb:duckdb 37055924 37761487 0.98
tpcds_q08/duckdb:duckdb 119648689 120430823 0.99
tpcds_q09/duckdb:duckdb 19753310 19704089 1.00
tpcds_q10/duckdb:duckdb 23222275 23225238 1.00
tpcds_q11/duckdb:duckdb 86229163 91731906 0.94
tpcds_q12/duckdb:duckdb 10804042 11124914 0.97
tpcds_q13/duckdb:duckdb 23912395 24334797 0.98
tpcds_q14/duckdb:duckdb 89467379 93726153 0.95
tpcds_q15/duckdb:duckdb 23621845 24702038 0.96
tpcds_q16/duckdb:duckdb 17359602 18136081 0.96
tpcds_q17/duckdb:duckdb 22000665 22834574 0.96
tpcds_q18/duckdb:duckdb 44880690 44412387 1.01
tpcds_q19/duckdb:duckdb 16482128 16604742 0.99
tpcds_q20/duckdb:duckdb 11103517 12008467 0.92
tpcds_q21/duckdb:duckdb 🚀 6293758 7063719 0.89
tpcds_q22/duckdb:duckdb 59345978 61249419 0.97
tpcds_q23/duckdb:duckdb 79842928 74538724 1.07
tpcds_q24/duckdb:duckdb 23845152 23955885 1.00
tpcds_q25/duckdb:duckdb 16473487 16666923 0.99
tpcds_q26/duckdb:duckdb 27570740 26517871 1.04
tpcds_q27/duckdb:duckdb 35941354 36774256 0.98
tpcds_q28/duckdb:duckdb 22217476 22319399 1.00
tpcds_q29/duckdb:duckdb 21136038 20363219 1.04
tpcds_q30/duckdb:duckdb 28633327 29808416 0.96
tpcds_q31/duckdb:duckdb 49307729 47699338 1.03
tpcds_q32/duckdb:duckdb 7967070 7302721 1.09
tpcds_q33/duckdb:duckdb 12714109 12894436 0.99
tpcds_q34/duckdb:duckdb 14759152 14795461 1.00
tpcds_q35/duckdb:duckdb 31653713 32395272 0.98
tpcds_q36/duckdb:duckdb 69251632 69223391 1.00
tpcds_q37/duckdb:duckdb 7379591 7757386 0.95
tpcds_q38/duckdb:duckdb 30319197 29758082 1.02
tpcds_q39/duckdb:duckdb 🚨 32545727 25884070 1.26
tpcds_q40/duckdb:duckdb 14005172 13015964 1.08
tpcds_q41/duckdb:duckdb 8328384 8588669 0.97
tpcds_q42/duckdb:duckdb 6444129 6402473 1.01
tpcds_q43/duckdb:duckdb 11313027 12122245 0.93
tpcds_q44/duckdb:duckdb 13347853 14712929 0.91
tpcds_q45/duckdb:duckdb 17648062 16943238 1.04
tpcds_q46/duckdb:duckdb 39685139 37337525 1.06
tpcds_q47/duckdb:duckdb 39301849 39158653 1.00
tpcds_q48/duckdb:duckdb 23321470 23002986 1.01
tpcds_q49/duckdb:duckdb 17112656 16950891 1.01
tpcds_q50/duckdb:duckdb 14059981 14001301 1.00
tpcds_q51/duckdb:duckdb 90105107 90866084 0.99
tpcds_q52/duckdb:duckdb 7119703 7153148 1.00
tpcds_q53/duckdb:duckdb 12910738 13330618 0.97
tpcds_q54/duckdb:duckdb 16479892 16260597 1.01
tpcds_q55/duckdb:duckdb 7656167 7364569 1.04
tpcds_q56/duckdb:duckdb 13428020 13186859 1.02
tpcds_q57/duckdb:duckdb 32608971 32563546 1.00
tpcds_q58/duckdb:duckdb 12230354 13180434 0.93
tpcds_q59/duckdb:duckdb 35423526 34603137 1.02
tpcds_q60/duckdb:duckdb 14831075 15221154 0.97
tpcds_q61/duckdb:duckdb 14713955 15196731 0.97
tpcds_q62/duckdb:duckdb 9602516 9356503 1.03
tpcds_q63/duckdb:duckdb 12439592 12149430 1.02
tpcds_q64/duckdb:duckdb 55008714 54635029 1.01
tpcds_q65/duckdb:duckdb 34276773 34655902 0.99
tpcds_q66/duckdb:duckdb 25471304 25277139 1.01
tpcds_q67/duckdb:duckdb 128059502 127169374 1.01
tpcds_q68/duckdb:duckdb 26382250 25075441 1.05
tpcds_q69/duckdb:duckdb 23401386 25126584 0.93
tpcds_q70/duckdb:duckdb 14499720 14740872 0.98
tpcds_q71/duckdb:duckdb 12069767 12127866 1.00
tpcds_q72/duckdb:duckdb 43515294 43311682 1.00
tpcds_q73/duckdb:duckdb 10533629 10946502 0.96
tpcds_q74/duckdb:duckdb 144804811 144415289 1.00
tpcds_q75/duckdb:duckdb 42172439 41117608 1.03
tpcds_q76/duckdb:duckdb 11819516 12189022 0.97
tpcds_q77/duckdb:duckdb 12193559 12284776 0.99
tpcds_q78/duckdb:duckdb 62849460 60806344 1.03
tpcds_q79/duckdb:duckdb 19052150 18689010 1.02
tpcds_q80/duckdb:duckdb 26346395 25729745 1.02
tpcds_q81/duckdb:duckdb 37862750 35419594 1.07
tpcds_q82/duckdb:duckdb 8168500 8762631 0.93
tpcds_q83/duckdb:duckdb 8934213 9229905 0.97
tpcds_q84/duckdb:duckdb 🚨 15587912 13938098 1.12
tpcds_q85/duckdb:duckdb 23991942 25030142 0.96
tpcds_q86/duckdb:duckdb 11363686 10660492 1.07
tpcds_q87/duckdb:duckdb 35024460 33634234 1.04
tpcds_q88/duckdb:duckdb 25613219 25779391 0.99
tpcds_q89/duckdb:duckdb 14969581 14789366 1.01
tpcds_q90/duckdb:duckdb 5461767 5557345 0.98
tpcds_q91/duckdb:duckdb 12773682 12275072 1.04
tpcds_q92/duckdb:duckdb 9199929 8996864 1.02
tpcds_q93/duckdb:duckdb 22281349 20643875 1.08
tpcds_q94/duckdb:duckdb 12243035 12808673 0.96
tpcds_q95/duckdb:duckdb 🚨 124239563 110071749 1.13
tpcds_q96/duckdb:duckdb 4620213 4769551 0.97
tpcds_q97/duckdb:duckdb 28803379 30068169 0.96
tpcds_q98/duckdb:duckdb 13318310 13606777 0.98
tpcds_q99/duckdb:duckdb 15919867 16257620 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.9% +8.4% -6.9% +23.4% ➖ noise
1 datafusion:vortex-file-compressed -6.6% +8.4% -13.8% +18.6% ➖ noise
1 duckdb:duckdb +0.5% +8.4% -7.3% +22.3% ➖ noise
1 duckdb:vortex-compact -2.0% +8.4% -9.6% +20.4% ➖ noise
1 duckdb:vortex-file-compressed -2.2% +8.4% -9.7% +32.6% ➖ noise
2 datafusion:vortex-compact -1.0% +0.5% -1.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.0% +0.5% -0.5% +10.0% ➖ noise
2 duckdb:duckdb -0.9% +0.5% -1.4% +14.4% ➖ noise
2 duckdb:vortex-compact +0.7% +0.5% +0.2% +26.3% ➖ noise
2 duckdb:vortex-file-compressed -8.1% +0.5% -8.5% +10.0% ➖ noise
3 datafusion:vortex-compact -2.9% +0.6% -3.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.3% +0.6% -1.8% +25.8% ➖ noise
3 duckdb:duckdb -1.2% +0.6% -1.7% +16.0% ➖ noise
3 duckdb:vortex-compact -0.3% +0.6% -0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.6% +0.6% +5.0% +10.0% ➖ noise
4 datafusion:vortex-compact +0.6% -0.2% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.4% -0.2% -3.1% +10.0% ➖ noise
4 duckdb:duckdb -4.7% -0.2% -4.5% +10.0% ➖ noise
4 duckdb:vortex-compact +5.5% -0.2% +5.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.2% -0.2% -6.0% +11.4% ➖ noise
5 datafusion:vortex-compact -2.4% +1.3% -3.6% +10.5% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +1.3% -1.1% +10.0% ➖ noise
5 duckdb:duckdb -2.4% +1.3% -3.6% +10.0% ➖ noise
5 duckdb:vortex-compact -3.7% +1.3% -4.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.3% +1.3% +2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +4.1% -3.7% +8.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.5% -3.7% +11.6% +10.0% 🚨 regression
6 duckdb:duckdb -3.9% -3.7% -0.3% +12.8% ➖ noise
6 duckdb:vortex-compact -5.8% -3.7% -2.2% +11.8% ➖ noise
6 duckdb:vortex-file-compressed -1.7% -3.7% +2.0% +10.0% ➖ noise
7 datafusion:vortex-compact +1.9% -0.4% +2.3% +16.0% ➖ noise
7 datafusion:vortex-file-compressed -0.5% -0.4% -0.2% +10.0% ➖ noise
7 duckdb:duckdb -1.9% -0.4% -1.5% +23.6% ➖ noise
7 duckdb:vortex-compact +1.4% -0.4% +1.8% +10.9% ➖ noise
7 duckdb:vortex-file-compressed -5.3% -0.4% -4.9% +20.7% ➖ noise
8 datafusion:vortex-compact -0.5% +1.8% -2.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.5% +1.8% -2.3% +10.0% ➖ noise
8 duckdb:duckdb -0.6% +1.8% -2.4% +10.0% ➖ noise
8 duckdb:vortex-compact +3.1% +1.8% +1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.2% +1.8% -2.9% +17.9% ➖ noise
9 datafusion:vortex-compact -2.3% +2.6% -4.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.5% +2.6% -4.0% +10.0% ➖ noise
9 duckdb:duckdb +0.2% +2.6% -2.3% +10.0% ➖ noise
9 duckdb:vortex-compact -3.0% +2.6% -5.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.3% +2.6% -5.7% +12.0% ➖ noise
10 datafusion:vortex-compact +0.2% +4.1% -3.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +13.3% +4.1% +8.9% +13.2% ➖ noise
10 duckdb:duckdb -0.0% +4.1% -3.9% +10.0% ➖ noise
10 duckdb:vortex-compact +4.7% +4.1% +0.6% +11.3% ➖ noise
10 duckdb:vortex-file-compressed -2.0% +4.1% -5.8% +10.0% ➖ noise
11 datafusion:vortex-compact -0.7% -1.9% +1.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.0% -1.9% +2.9% +10.0% ➖ noise
11 duckdb:duckdb -6.0% -1.9% -4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +1.7% -1.9% +3.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.6% -1.9% -0.7% +10.1% ➖ noise
12 datafusion:vortex-compact -12.0% +4.2% -15.5% +16.1% ✅ faster
12 datafusion:vortex-file-compressed -0.8% +4.2% -4.9% +10.7% ➖ noise
12 duckdb:duckdb -2.9% +4.2% -6.8% +17.2% ➖ noise
12 duckdb:vortex-compact -2.0% +4.2% -5.9% +13.1% ➖ noise
12 duckdb:vortex-file-compressed -2.7% +4.2% -6.6% +12.5% ➖ noise
13 datafusion:vortex-compact -0.6% +0.7% -1.3% +18.0% ➖ noise
13 datafusion:vortex-file-compressed -5.7% +0.7% -6.4% +10.0% ➖ noise
13 duckdb:duckdb -1.7% +0.7% -2.4% +10.0% ➖ noise
13 duckdb:vortex-compact +4.5% +0.7% +3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.6% +0.7% -3.3% +10.0% ➖ noise
14 datafusion:vortex-compact +0.3% +0.7% -0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
14 duckdb:duckdb -4.5% +0.7% -5.2% +10.0% ➖ noise
14 duckdb:vortex-compact +0.4% +0.7% -0.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.7% +0.7% -2.4% +10.0% ➖ noise
15 datafusion:vortex-compact -3.9% -2.1% -1.8% +14.1% ➖ noise
15 datafusion:vortex-file-compressed -0.6% -2.1% +1.5% +15.1% ➖ noise
15 duckdb:duckdb -4.4% -2.1% -2.3% +12.3% ➖ noise
15 duckdb:vortex-compact -0.6% -2.1% +1.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.5% -2.1% -1.4% +10.0% ➖ noise
16 datafusion:vortex-compact -0.8% -0.9% +0.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.4% -0.9% -0.5% +10.0% ➖ noise
16 duckdb:duckdb -4.3% -0.9% -3.4% +14.1% ➖ noise
16 duckdb:vortex-compact -0.4% -0.9% +0.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +10.0% ➖ noise
17 datafusion:vortex-compact -4.9% -3.2% -1.8% +10.1% ➖ noise
17 datafusion:vortex-file-compressed -0.3% -3.2% +3.0% +10.0% ➖ noise
17 duckdb:duckdb -3.7% -3.2% -0.5% +14.2% ➖ noise
17 duckdb:vortex-compact -5.0% -3.2% -1.9% +14.5% ➖ noise
17 duckdb:vortex-file-compressed -0.2% -3.2% +3.1% +10.0% ➖ noise
18 datafusion:vortex-compact +0.4% -4.7% +5.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.7% -4.7% +4.2% +10.4% ➖ noise
18 duckdb:duckdb +1.1% -4.7% +6.1% +11.0% ➖ noise
18 duckdb:vortex-compact +2.6% -4.7% +7.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -5.8% -4.7% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact -3.1% -0.9% -2.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.3% -0.9% -4.4% +22.9% ➖ noise
19 duckdb:duckdb -0.7% -0.9% +0.2% +12.0% ➖ noise
19 duckdb:vortex-compact +0.8% -0.9% +1.7% +11.1% ➖ noise
19 duckdb:vortex-file-compressed +0.0% -0.9% +1.0% +11.4% ➖ noise
20 datafusion:vortex-compact +0.5% -0.7% +1.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.4% -0.7% +4.1% +10.0% ➖ noise
20 duckdb:duckdb -7.5% -0.7% -6.9% +11.2% ➖ noise
20 duckdb:vortex-compact -5.9% -0.7% -5.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.8% -0.7% +2.4% +10.9% ➖ noise
21 datafusion:vortex-compact -4.6% -0.6% -4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.1% -0.6% +2.7% +10.0% ➖ noise
21 duckdb:duckdb -10.9% -0.6% -10.4% +18.6% ➖ noise
21 duckdb:vortex-compact +4.0% -0.6% +4.7% +14.1% ➖ noise
21 duckdb:vortex-file-compressed -4.9% -0.6% -4.3% +14.2% ➖ noise
22 datafusion:vortex-compact -7.5% +4.3% -11.3% +29.0% ➖ noise
22 datafusion:vortex-file-compressed -23.0% +4.3% -26.2% +32.7% ✅ faster
22 duckdb:duckdb -3.1% +4.3% -7.1% +15.2% ➖ noise
22 duckdb:vortex-compact -6.8% +4.3% -10.6% +15.2% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +4.3% -4.8% +14.5% ➖ noise
23 datafusion:vortex-compact +1.4% +2.4% -1.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -0.6% +2.4% -3.0% +11.1% ➖ noise
23 duckdb:duckdb +7.1% +2.4% +4.6% +16.3% ➖ noise
23 duckdb:vortex-compact -0.3% +2.4% -2.7% +11.8% ➖ noise
23 duckdb:vortex-file-compressed -0.7% +2.4% -3.1% +14.2% ➖ noise
24 datafusion:vortex-compact -0.4% +0.4% -0.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +11.1% ➖ noise
24 duckdb:duckdb -0.5% +0.4% -0.9% +10.1% ➖ noise
24 duckdb:vortex-compact -2.2% +0.4% -2.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +0.4% +0.4% -0.0% +12.9% ➖ noise
25 datafusion:vortex-compact -1.2% -0.6% -0.6% +10.3% ➖ noise
25 datafusion:vortex-file-compressed -0.0% -0.6% +0.5% +10.0% ➖ noise
25 duckdb:duckdb -1.2% -0.6% -0.6% +10.6% ➖ noise
25 duckdb:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.9% -0.6% +3.5% +10.9% ➖ noise
26 datafusion:vortex-compact -6.8% +0.5% -7.3% +11.0% ➖ noise
26 datafusion:vortex-file-compressed -2.1% +0.5% -2.6% +10.0% ➖ noise
26 duckdb:duckdb +4.0% +0.5% +3.4% +11.4% ➖ noise
26 duckdb:vortex-compact -0.6% +0.5% -1.1% +12.6% ➖ noise
26 duckdb:vortex-file-compressed -5.6% +0.5% -6.1% +10.0% ➖ noise
27 datafusion:vortex-compact -3.8% -0.6% -3.2% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.8% -0.6% +1.4% +10.0% ➖ noise
27 duckdb:duckdb -2.3% -0.6% -1.7% +17.8% ➖ noise
27 duckdb:vortex-compact -2.6% -0.6% -2.0% +14.4% ➖ noise
27 duckdb:vortex-file-compressed -8.3% -0.6% -7.8% +16.4% ➖ noise
28 datafusion:vortex-compact -2.9% -0.6% -2.3% +14.2% ➖ noise
28 datafusion:vortex-file-compressed -5.1% -0.6% -4.6% +10.0% ➖ noise
28 duckdb:duckdb -0.5% -0.6% +0.1% +10.0% ➖ noise
28 duckdb:vortex-compact -0.6% -0.6% +0.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.4% -0.6% +0.2% +10.0% ➖ noise
29 datafusion:vortex-compact +0.8% +0.7% +0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.6% +0.7% -5.3% +10.0% ➖ noise
29 duckdb:duckdb +3.8% +0.7% +3.1% +12.1% ➖ noise
29 duckdb:vortex-compact -1.8% +0.7% -2.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +0.5% +0.7% -0.2% +10.0% ➖ noise
30 datafusion:vortex-compact +3.5% -1.1% +4.7% +10.9% ➖ noise
30 datafusion:vortex-file-compressed +0.7% -1.1% +1.8% +13.3% ➖ noise
30 duckdb:duckdb -3.9% -1.1% -2.9% +10.0% ➖ noise
30 duckdb:vortex-compact +1.9% -1.1% +3.0% +12.0% ➖ noise
30 duckdb:vortex-file-compressed -0.8% -1.1% +0.3% +10.0% ➖ noise
31 datafusion:vortex-compact -2.3% -1.2% -1.1% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.3% ➖ noise
31 duckdb:duckdb +3.4% -1.2% +4.7% +12.3% ➖ noise
31 duckdb:vortex-compact +2.3% -1.2% +3.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -2.4% -1.2% -1.2% +10.1% ➖ noise
32 datafusion:vortex-compact -2.3% +1.6% -3.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.0% +1.6% -0.6% +10.0% ➖ noise
32 duckdb:duckdb +9.1% +1.6% +7.4% +15.1% ➖ noise
32 duckdb:vortex-compact -3.2% +1.6% -4.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -6.5% +1.6% -7.9% +10.1% ➖ noise
33 datafusion:vortex-compact -1.6% -2.2% +0.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.5% -2.2% +2.7% +10.0% ➖ noise
33 duckdb:duckdb -1.4% -2.2% +0.8% +10.8% ➖ noise
33 duckdb:vortex-compact -1.7% -2.2% +0.5% +14.6% ➖ noise
33 duckdb:vortex-file-compressed -1.9% -2.2% +0.3% +10.0% ➖ noise
34 datafusion:vortex-compact -0.5% -4.2% +3.8% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -2.2% -4.2% +2.1% +10.0% ➖ noise
34 duckdb:duckdb -0.2% -4.2% +4.1% +10.0% ➖ noise
34 duckdb:vortex-compact +2.8% -4.2% +7.2% +15.7% ➖ noise
34 duckdb:vortex-file-compressed +2.3% -4.2% +6.8% +10.0% ➖ noise
35 datafusion:vortex-compact -1.6% -3.0% +1.5% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -1.1% -3.0% +2.0% +10.0% ➖ noise
35 duckdb:duckdb -2.3% -3.0% +0.7% +14.5% ➖ noise
35 duckdb:vortex-compact -0.0% -3.0% +3.1% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.9% -3.0% +4.1% +10.0% ➖ noise
36 datafusion:vortex-compact -3.5% +0.4% -3.8% +10.5% ➖ noise
36 datafusion:vortex-file-compressed -0.0% +0.4% -0.4% +12.5% ➖ noise
36 duckdb:duckdb +0.0% +0.4% -0.3% +10.0% ➖ noise
36 duckdb:vortex-compact +0.9% +0.4% +0.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.5% +0.4% +0.1% +17.6% ➖ noise
37 datafusion:vortex-compact +4.6% +2.4% +2.2% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +0.5% +2.4% -1.9% +12.3% ➖ noise
37 duckdb:duckdb -4.9% +2.4% -7.1% +14.1% ➖ noise
37 duckdb:vortex-compact +0.5% +2.4% -1.9% +11.1% ➖ noise
37 duckdb:vortex-file-compressed -6.6% +2.4% -8.8% +10.4% ➖ noise
38 datafusion:vortex-compact +2.4% -0.4% +2.9% +10.9% ➖ noise
38 datafusion:vortex-file-compressed +0.5% -0.4% +0.9% +10.0% ➖ noise
38 duckdb:duckdb +1.9% -0.4% +2.3% +10.8% ➖ noise
38 duckdb:vortex-compact +2.9% -0.4% +3.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +3.1% -0.4% +3.5% +11.1% ➖ noise
39 datafusion:vortex-compact -4.6% -0.5% -4.1% +12.1% ➖ noise
39 datafusion:vortex-file-compressed -1.5% -0.5% -1.0% +10.0% ➖ noise
39 duckdb:duckdb +25.7% -0.5% +26.3% +29.0% ➖ noise
39 duckdb:vortex-compact -0.4% -0.5% +0.1% +20.8% ➖ noise
39 duckdb:vortex-file-compressed -0.9% -0.5% -0.5% +11.9% ➖ noise
40 datafusion:vortex-compact +1.5% -0.0% +1.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +0.7% -0.0% +0.8% +10.9% ➖ noise
40 duckdb:duckdb +7.6% -0.0% +7.6% +10.0% ➖ noise
40 duckdb:vortex-compact +3.8% -0.0% +3.9% +12.2% ➖ noise
40 duckdb:vortex-file-compressed +2.5% -0.0% +2.6% +14.8% ➖ noise
41 datafusion:vortex-compact -0.5% +0.2% -0.7% +11.6% ➖ noise
41 datafusion:vortex-file-compressed +2.5% +0.2% +2.2% +10.0% ➖ noise
41 duckdb:duckdb -3.0% +0.2% -3.2% +10.0% ➖ noise
41 duckdb:vortex-compact -1.2% +0.2% -1.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
42 datafusion:vortex-compact -1.0% +1.6% -2.6% +11.1% ➖ noise
42 datafusion:vortex-file-compressed +1.2% +1.6% -0.4% +10.0% ➖ noise
42 duckdb:duckdb +0.7% +1.6% -1.0% +16.0% ➖ noise
42 duckdb:vortex-compact -0.3% +1.6% -1.9% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -2.1% +1.6% -3.7% +13.7% ➖ noise
43 datafusion:vortex-compact -1.6% -1.2% -0.4% +12.2% ➖ noise
43 datafusion:vortex-file-compressed +0.9% -1.2% +2.2% +10.2% ➖ noise
43 duckdb:duckdb -6.7% -1.2% -5.6% +12.3% ➖ noise
43 duckdb:vortex-compact -0.5% -1.2% +0.7% +23.2% ➖ noise
43 duckdb:vortex-file-compressed -1.9% -1.2% -0.7% +12.9% ➖ noise
44 datafusion:vortex-compact -7.0% -3.4% -3.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.1% -3.4% -1.8% +10.6% ➖ noise
44 duckdb:duckdb -9.3% -3.4% -6.1% +13.8% ➖ noise
44 duckdb:vortex-compact +1.5% -3.4% +5.1% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +0.8% -3.4% +4.3% +10.0% ➖ noise
45 datafusion:vortex-compact -2.4% -1.2% -1.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +2.3% -1.2% +3.6% +10.0% ➖ noise
45 duckdb:duckdb +4.2% -1.2% +5.5% +10.2% ➖ noise
45 duckdb:vortex-compact -1.3% -1.2% -0.0% +11.7% ➖ noise
45 duckdb:vortex-file-compressed -2.1% -1.2% -0.9% +10.0% ➖ noise
46 datafusion:vortex-compact -1.4% -1.4% +0.0% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.7% -1.4% -1.3% +14.7% ➖ noise
46 duckdb:duckdb +6.3% -1.4% +7.8% +10.0% ➖ noise
46 duckdb:vortex-compact +5.0% -1.4% +6.6% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.7% -1.4% +0.7% +10.0% ➖ noise
47 datafusion:vortex-compact +1.3% -1.5% +2.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.3% -1.5% +2.8% +10.0% ➖ noise
47 duckdb:duckdb +0.4% -1.5% +1.9% +10.7% ➖ noise
47 duckdb:vortex-compact +0.0% -1.5% +1.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -4.6% -1.5% -3.2% +10.0% ➖ noise
48 datafusion:vortex-compact -3.9% -1.8% -2.1% +10.3% ➖ noise
48 datafusion:vortex-file-compressed -7.2% -1.8% -5.5% +10.0% ➖ noise
48 duckdb:duckdb +1.4% -1.8% +3.3% +10.0% ➖ noise
48 duckdb:vortex-compact -4.8% -1.8% -3.0% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.6% -1.8% +1.2% +11.3% ➖ noise
49 datafusion:vortex-compact -8.0% +0.7% -8.6% +11.3% ➖ noise
49 datafusion:vortex-file-compressed -1.9% +0.7% -2.6% +11.7% ➖ noise
49 duckdb:duckdb +1.0% +0.7% +0.3% +15.6% ➖ noise
49 duckdb:vortex-compact -6.8% +0.7% -7.4% +11.5% ➖ noise
49 duckdb:vortex-file-compressed +13.4% +0.7% +12.6% +25.4% ➖ noise
50 datafusion:vortex-compact -2.1% +1.5% -3.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -0.3% +1.5% -1.8% +10.0% ➖ noise
50 duckdb:duckdb +0.4% +1.5% -1.1% +10.7% ➖ noise
50 duckdb:vortex-compact +1.1% +1.5% -0.5% +12.2% ➖ noise
50 duckdb:vortex-file-compressed +1.6% +1.5% +0.1% +10.0% ➖ noise
51 datafusion:vortex-compact +0.1% -1.2% +1.4% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +0.2% -1.2% +1.5% +10.0% ➖ noise
51 duckdb:duckdb -0.8% -1.2% +0.4% +10.0% ➖ noise
51 duckdb:vortex-compact -2.6% -1.2% -1.4% +10.0% ➖ noise
51 duckdb:vortex-file-compressed -2.7% -1.2% -1.5% +10.0% ➖ noise
52 datafusion:vortex-compact -7.1% -9.1% +2.2% +13.0% ➖ noise
52 datafusion:vortex-file-compressed +3.2% -9.1% +13.5% +10.0% 🚨 regression
52 duckdb:duckdb -0.5% -9.1% +9.5% +17.6% ➖ noise
52 duckdb:vortex-compact -1.5% -9.1% +8.3% +10.9% ➖ noise
52 duckdb:vortex-file-compressed +4.0% -9.1% +14.4% +29.8% ➖ noise
53 datafusion:vortex-compact -0.4% +0.6% -1.0% +13.5% ➖ noise
53 datafusion:vortex-file-compressed +1.0% +0.6% +0.4% +17.4% ➖ noise
53 duckdb:duckdb -3.1% +0.6% -3.7% +10.0% ➖ noise
53 duckdb:vortex-compact +2.4% +0.6% +1.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
54 datafusion:vortex-compact -0.2% -4.2% +4.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.3% -4.2% +4.0% +15.9% ➖ noise
54 duckdb:duckdb +1.3% -4.2% +5.7% +11.1% ➖ noise
54 duckdb:vortex-compact -7.3% -4.2% -3.3% +13.0% ➖ noise
54 duckdb:vortex-file-compressed -3.0% -4.2% +1.2% +10.0% ➖ noise
55 datafusion:vortex-compact -2.2% +1.6% -3.7% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -1.4% +1.6% -2.9% +10.0% ➖ noise
55 duckdb:duckdb +4.0% +1.6% +2.4% +16.7% ➖ noise
55 duckdb:vortex-compact -7.7% +1.6% -9.1% +16.2% ➖ noise
55 duckdb:vortex-file-compressed +0.1% +1.6% -1.4% +10.5% ➖ noise
56 datafusion:vortex-compact -3.4% -0.7% -2.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +1.8% -0.7% +2.5% +10.0% ➖ noise
56 duckdb:duckdb +1.8% -0.7% +2.5% +10.0% ➖ noise
56 duckdb:vortex-compact -1.7% -0.7% -1.0% +10.7% ➖ noise
56 duckdb:vortex-file-compressed -1.7% -0.7% -1.1% +23.5% ➖ noise
57 datafusion:vortex-compact -0.1% -4.0% +4.0% +10.2% ➖ noise
57 datafusion:vortex-file-compressed -5.7% -4.0% -1.8% +10.0% ➖ noise
57 duckdb:duckdb +0.1% -4.0% +4.3% +17.8% ➖ noise
57 duckdb:vortex-compact +1.8% -4.0% +6.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -1.0% -4.0% +3.1% +10.0% ➖ noise
58 datafusion:vortex-compact -0.8% -0.9% +0.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -4.1% -0.9% -3.3% +10.0% ➖ noise
58 duckdb:duckdb -7.2% -0.9% -6.4% +12.2% ➖ noise
58 duckdb:vortex-compact -0.0% -0.9% +0.9% +10.0% ➖ noise
58 duckdb:vortex-file-compressed +2.1% -0.9% +3.0% +10.0% ➖ noise
59 datafusion:vortex-compact -0.2% +0.8% -1.0% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
59 duckdb:duckdb +2.4% +0.8% +1.6% +10.0% ➖ noise
59 duckdb:vortex-compact +0.8% +0.8% +0.0% +10.4% ➖ noise
59 duckdb:vortex-file-compressed +1.6% +0.8% +0.8% +10.0% ➖ noise
60 datafusion:vortex-compact +4.4% +0.2% +4.2% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -2.0% +0.2% -2.3% +10.0% ➖ noise
60 duckdb:duckdb -2.6% +0.2% -2.8% +11.9% ➖ noise
60 duckdb:vortex-compact +2.8% +0.2% +2.6% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.1% +0.2% -0.2% +15.5% ➖ noise
61 datafusion:vortex-compact +2.3% -2.0% +4.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.8% -2.0% +0.2% +10.0% ➖ noise
61 duckdb:duckdb -3.2% -2.0% -1.2% +10.0% ➖ noise
61 duckdb:vortex-compact +2.0% -2.0% +4.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +15.0% -2.0% +17.3% +17.0% 🚨 regression
62 datafusion:vortex-compact -13.2% +8.8% -20.2% +26.7% ➖ noise
62 datafusion:vortex-file-compressed +2.6% +8.8% -5.7% +22.5% ➖ noise
62 duckdb:duckdb +2.6% +8.8% -5.7% +24.9% ➖ noise
62 duckdb:vortex-compact +5.5% +8.8% -3.0% +23.6% ➖ noise
62 duckdb:vortex-file-compressed +4.3% +8.8% -4.1% +20.7% ➖ noise
63 datafusion:vortex-compact -0.4% -0.8% +0.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -2.8% -0.8% -2.0% +10.0% ➖ noise
63 duckdb:duckdb +2.4% -0.8% +3.2% +10.0% ➖ noise
63 duckdb:vortex-compact +3.4% -0.8% +4.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.5% -0.8% +1.3% +10.0% ➖ noise
64 datafusion:vortex-compact +0.1% -0.1% +0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.7% -0.1% -0.7% +10.0% ➖ noise
64 duckdb:duckdb +0.7% -0.1% +0.8% +10.0% ➖ noise
64 duckdb:vortex-compact -3.6% -0.1% -3.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -5.8% -0.1% -5.7% +10.3% ➖ noise
65 datafusion:vortex-compact +1.8% +0.7% +1.0% +21.7% ➖ noise
65 datafusion:vortex-file-compressed -1.1% +0.7% -1.8% +10.0% ➖ noise
65 duckdb:duckdb -1.1% +0.7% -1.8% +16.2% ➖ noise
65 duckdb:vortex-compact -1.2% +0.7% -1.9% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.4% +0.7% +1.7% +10.0% ➖ noise
66 datafusion:vortex-compact +3.8% +4.6% -0.8% +12.2% ➖ noise
66 datafusion:vortex-file-compressed -2.5% +4.6% -6.8% +13.0% ➖ noise
66 duckdb:duckdb +0.8% +4.6% -3.7% +11.1% ➖ noise
66 duckdb:vortex-compact -11.7% +4.6% -15.6% +16.5% ✅ faster
66 duckdb:vortex-file-compressed +0.2% +4.6% -4.2% +10.1% ➖ noise
67 datafusion:vortex-compact -6.0% +1.6% -7.5% +10.8% ➖ noise
67 datafusion:vortex-file-compressed +3.9% +1.6% +2.3% +11.1% ➖ noise
67 duckdb:duckdb +0.7% +1.6% -0.9% +10.0% ➖ noise
67 duckdb:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -1.7% +1.6% -3.2% +10.0% ➖ noise
68 datafusion:vortex-compact -0.9% -2.7% +1.9% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -2.6% -2.7% +0.0% +10.9% ➖ noise
68 duckdb:duckdb +5.2% -2.7% +8.1% +12.8% ➖ noise
68 duckdb:vortex-compact -1.8% -2.7% +0.9% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.4% -2.7% -1.8% +10.0% ➖ noise
69 datafusion:vortex-compact -1.3% -0.5% -0.8% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.0% -0.5% +0.5% +10.0% ➖ noise
69 duckdb:duckdb -6.9% -0.5% -6.4% +10.8% ➖ noise
69 duckdb:vortex-compact -1.4% -0.5% -0.9% +10.5% ➖ noise
69 duckdb:vortex-file-compressed +2.4% -0.5% +2.9% +10.6% ➖ noise
70 datafusion:vortex-compact +0.4% -2.3% +2.8% +17.4% ➖ noise
70 datafusion:vortex-file-compressed -5.2% -2.3% -3.0% +13.8% ➖ noise
70 duckdb:duckdb -1.6% -2.3% +0.7% +15.9% ➖ noise
70 duckdb:vortex-compact -2.3% -2.3% -0.0% +14.1% ➖ noise
70 duckdb:vortex-file-compressed -5.5% -2.3% -3.3% +16.2% ➖ noise
71 datafusion:vortex-compact +0.7% +1.0% -0.3% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -2.6% +1.0% -3.5% +10.0% ➖ noise
71 duckdb:duckdb -0.5% +1.0% -1.5% +12.3% ➖ noise
71 duckdb:vortex-compact +0.4% +1.0% -0.6% +10.4% ➖ noise
71 duckdb:vortex-file-compressed +6.3% +1.0% +5.2% +10.0% ➖ noise
72 datafusion:vortex-compact -0.5% -0.3% -0.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +10.0% ➖ noise
72 duckdb:duckdb +0.5% -0.3% +0.8% +10.0% ➖ noise
72 duckdb:vortex-compact -1.3% -0.3% -0.9% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.1% -0.3% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact -1.4% -0.5% -0.9% +10.4% ➖ noise
73 datafusion:vortex-file-compressed -2.6% -0.5% -2.1% +10.0% ➖ noise
73 duckdb:duckdb -3.8% -0.5% -3.3% +13.9% ➖ noise
73 duckdb:vortex-compact +2.3% -0.5% +2.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +3.8% -0.5% +4.2% +10.0% ➖ noise
74 datafusion:vortex-compact +0.8% +0.1% +0.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -3.3% +0.1% -3.4% +15.6% ➖ noise
74 duckdb:duckdb +0.3% +0.1% +0.2% +10.0% ➖ noise
74 duckdb:vortex-compact +0.3% +0.1% +0.1% +22.8% ➖ noise
74 duckdb:vortex-file-compressed -9.3% +0.1% -9.4% +28.4% ➖ noise
75 datafusion:vortex-compact -3.4% +1.7% -5.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -5.0% +1.7% -6.6% +12.8% ➖ noise
75 duckdb:duckdb +2.6% +1.7% +0.9% +10.5% ➖ noise
75 duckdb:vortex-compact +3.4% +1.7% +1.7% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +2.2% +1.7% +0.5% +10.0% ➖ noise
76 datafusion:vortex-compact +1.4% +0.6% +0.8% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -3.1% +0.6% -3.7% +15.6% ➖ noise
76 duckdb:duckdb -3.0% +0.6% -3.6% +15.9% ➖ noise
76 duckdb:vortex-compact -4.8% +0.6% -5.4% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -9.3% +0.6% -9.8% +23.2% ➖ noise
77 datafusion:vortex-compact -4.5% +0.8% -5.2% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -2.5% +0.8% -3.3% +15.6% ➖ noise
77 duckdb:duckdb -0.7% +0.8% -1.5% +10.0% ➖ noise
77 duckdb:vortex-compact +7.1% +0.8% +6.3% +17.7% ➖ noise
77 duckdb:vortex-file-compressed +1.0% +0.8% +0.3% +22.5% ➖ noise
78 datafusion:vortex-compact -1.1% +1.8% -2.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.9% +1.8% -3.6% +10.0% ➖ noise
78 duckdb:duckdb +3.4% +1.8% +1.5% +11.2% ➖ noise
78 duckdb:vortex-compact -2.0% +1.8% -3.8% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.8% +1.8% -3.5% +10.0% ➖ noise
79 datafusion:vortex-compact -1.3% +1.1% -2.3% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -3.8% +1.1% -4.9% +10.0% ➖ noise
79 duckdb:duckdb +1.9% +1.1% +0.8% +10.0% ➖ noise
79 duckdb:vortex-compact -1.1% +1.1% -2.2% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.8% +1.1% -1.9% +10.0% ➖ noise
80 datafusion:vortex-compact -1.6% +0.3% -1.9% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.8% +0.3% +1.5% +10.8% ➖ noise
80 duckdb:duckdb +2.4% +0.3% +2.1% +26.2% ➖ noise
80 duckdb:vortex-compact -2.0% +0.3% -2.3% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -9.2% +0.3% -9.5% +11.2% ➖ noise
81 datafusion:vortex-compact +6.3% -1.8% +8.3% +10.5% ➖ noise
81 datafusion:vortex-file-compressed -2.3% -1.8% -0.5% +10.0% ➖ noise
81 duckdb:duckdb +6.9% -1.8% +8.9% +10.2% ➖ noise
81 duckdb:vortex-compact -6.9% -1.8% -5.1% +12.5% ➖ noise
81 duckdb:vortex-file-compressed -3.3% -1.8% -1.5% +11.8% ➖ noise
82 datafusion:vortex-compact -1.4% +4.7% -5.8% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -3.3% +4.7% -7.6% +13.5% ➖ noise
82 duckdb:duckdb -6.8% +4.7% -10.9% +14.3% ➖ noise
82 duckdb:vortex-compact -10.7% +4.7% -14.7% +11.7% ✅ faster
82 duckdb:vortex-file-compressed -0.8% +4.7% -5.2% +10.4% ➖ noise
83 datafusion:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -4.2% -1.3% -2.9% +10.0% ➖ noise
83 duckdb:duckdb -3.2% -1.3% -1.9% +13.5% ➖ noise
83 duckdb:vortex-compact -0.4% -1.3% +0.9% +10.2% ➖ noise
83 duckdb:vortex-file-compressed -2.6% -1.3% -1.3% +11.1% ➖ noise
84 datafusion:vortex-compact -5.5% -2.1% -3.5% +15.6% ➖ noise
84 datafusion:vortex-file-compressed -1.5% -2.1% +0.6% +10.0% ➖ noise
84 duckdb:duckdb +11.8% -2.1% +14.3% +11.3% 🚨 regression
84 duckdb:vortex-compact +1.0% -2.1% +3.1% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -5.9% -2.1% -3.8% +14.9% ➖ noise
85 datafusion:vortex-compact -2.8% +0.3% -3.1% +12.6% ➖ noise
85 datafusion:vortex-file-compressed -3.3% +0.3% -3.6% +10.0% ➖ noise
85 duckdb:duckdb -4.1% +0.3% -4.4% +10.0% ➖ noise
85 duckdb:vortex-compact -8.5% +0.3% -8.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +4.8% +0.3% +4.6% +10.0% ➖ noise
86 datafusion:vortex-compact -6.0% -2.4% -3.7% +20.1% ➖ noise
86 datafusion:vortex-file-compressed -2.5% -2.4% -0.1% +18.2% ➖ noise
86 duckdb:duckdb +6.6% -2.4% +9.2% +15.3% ➖ noise
86 duckdb:vortex-compact -3.3% -2.4% -0.9% +20.8% ➖ noise
86 duckdb:vortex-file-compressed -0.6% -2.4% +1.9% +13.1% ➖ noise
87 datafusion:vortex-compact -5.6% +2.3% -7.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.0% +2.3% -3.3% +10.9% ➖ noise
87 duckdb:duckdb +4.1% +2.3% +1.8% +10.4% ➖ noise
87 duckdb:vortex-compact +4.7% +2.3% +2.3% +10.8% ➖ noise
87 duckdb:vortex-file-compressed -5.7% +2.3% -7.8% +15.1% ➖ noise
88 datafusion:vortex-compact -0.7% +2.1% -2.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.8% +2.1% -4.8% +10.0% ➖ noise
88 duckdb:duckdb -0.6% +2.1% -2.7% +10.0% ➖ noise
88 duckdb:vortex-compact -3.3% +2.1% -5.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.6% +2.1% -4.7% +11.2% ➖ noise
89 datafusion:vortex-compact -0.5% +3.0% -3.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -1.1% +3.0% -4.0% +10.0% ➖ noise
89 duckdb:duckdb +1.2% +3.0% -1.7% +10.9% ➖ noise
89 duckdb:vortex-compact -1.6% +3.0% -4.5% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -1.6% +3.0% -4.5% +12.9% ➖ noise
90 datafusion:vortex-compact +2.1% -1.8% +4.1% +15.9% ➖ noise
90 datafusion:vortex-file-compressed +3.8% -1.8% +5.7% +15.3% ➖ noise
90 duckdb:duckdb -1.7% -1.8% +0.1% +10.0% ➖ noise
90 duckdb:vortex-compact -2.2% -1.8% -0.4% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -3.8% -1.8% -2.0% +10.0% ➖ noise
91 datafusion:vortex-compact -2.9% +1.1% -4.0% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +1.5% +1.1% +0.4% +10.0% ➖ noise
91 duckdb:duckdb +4.1% +1.1% +2.9% +10.7% ➖ noise
91 duckdb:vortex-compact +3.0% +1.1% +1.8% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +1.6% +1.1% +0.5% +10.0% ➖ noise
92 datafusion:vortex-compact -3.9% +2.6% -6.3% +17.5% ➖ noise
92 datafusion:vortex-file-compressed -3.9% +2.6% -6.3% +14.2% ➖ noise
92 duckdb:duckdb +2.3% +2.6% -0.3% +22.9% ➖ noise
92 duckdb:vortex-compact -7.8% +2.6% -10.1% +22.7% ➖ noise
92 duckdb:vortex-file-compressed +6.8% +2.6% +4.2% +21.4% ➖ noise
93 datafusion:vortex-compact -3.2% -1.7% -1.5% +10.0% ➖ noise
93 datafusion:vortex-file-compressed -1.9% -1.7% -0.2% +10.0% ➖ noise
93 duckdb:duckdb +7.9% -1.7% +9.8% +15.6% ➖ noise
93 duckdb:vortex-compact -0.4% -1.7% +1.3% +10.1% ➖ noise
93 duckdb:vortex-file-compressed -1.7% -1.7% +0.0% +10.0% ➖ noise
94 datafusion:vortex-compact +11.1% +2.9% +8.0% +11.4% ➖ noise
94 datafusion:vortex-file-compressed -9.7% +2.9% -12.2% +11.7% ✅ faster
94 duckdb:duckdb -4.4% +2.9% -7.1% +13.9% ➖ noise
94 duckdb:vortex-compact +6.5% +2.9% +3.5% +18.3% ➖ noise
94 duckdb:vortex-file-compressed +1.2% +2.9% -1.7% +10.0% ➖ noise
95 datafusion:vortex-compact +1.8% +8.7% -6.4% +10.1% ➖ noise
95 datafusion:vortex-file-compressed +0.9% +8.7% -7.2% +10.3% ➖ noise
95 duckdb:duckdb +12.9% +8.7% +3.8% +19.4% ➖ noise
95 duckdb:vortex-compact +3.3% +8.7% -5.0% +15.3% ➖ noise
95 duckdb:vortex-file-compressed +0.1% +8.7% -7.9% +13.0% ➖ noise
96 datafusion:vortex-compact -1.2% -6.1% +5.2% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +1.5% -6.1% +8.1% +10.6% ➖ noise
96 duckdb:duckdb -3.1% -6.1% +3.2% +17.5% ➖ noise
96 duckdb:vortex-compact +2.2% -6.1% +8.8% +13.9% ➖ noise
96 duckdb:vortex-file-compressed -6.7% -6.1% -0.7% +17.1% ➖ noise
97 datafusion:vortex-compact -0.2% -2.3% +2.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.6% -2.3% +3.1% +10.0% ➖ noise
97 duckdb:duckdb -4.2% -2.3% -1.9% +17.1% ➖ noise
97 duckdb:vortex-compact +2.8% -2.3% +5.3% +17.0% ➖ noise
97 duckdb:vortex-file-compressed +3.2% -2.3% +5.7% +13.3% ➖ noise
98 datafusion:vortex-compact -1.4% -2.8% +1.5% +12.9% ➖ noise
98 datafusion:vortex-file-compressed -2.4% -2.8% +0.4% +11.3% ➖ noise
98 duckdb:duckdb -2.1% -2.8% +0.7% +17.1% ➖ noise
98 duckdb:vortex-compact +1.0% -2.8% +3.9% +10.5% ➖ noise
98 duckdb:vortex-file-compressed +2.9% -2.8% +5.9% +10.4% ➖ noise
99 datafusion:vortex-compact -0.3% -8.3% +8.7% +25.7% ➖ noise
99 datafusion:vortex-file-compressed +2.4% -8.3% +11.7% +24.6% ➖ noise
99 duckdb:duckdb -2.1% -8.3% +6.8% +29.1% ➖ noise
99 duckdb:vortex-compact +9.0% -8.3% +18.9% +21.5% ➖ noise
99 duckdb:vortex-file-compressed -1.1% -8.3% +7.8% +27.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.1%


datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50369957 48662830 1.04
tpch_q02/datafusion:vortex-file-compressed 21538201 22131273 0.97
tpch_q03/datafusion:vortex-file-compressed 28134375 27901768 1.01
tpch_q04/datafusion:vortex-file-compressed 20443145 21162909 0.97
tpch_q05/datafusion:vortex-file-compressed 47563529 47405349 1.00
tpch_q06/datafusion:vortex-file-compressed 12880989 12248266 1.05
tpch_q07/datafusion:vortex-file-compressed 54361686 53769548 1.01
tpch_q08/datafusion:vortex-file-compressed 38425496 38676681 0.99
tpch_q09/datafusion:vortex-file-compressed 50281170 50830499 0.99
tpch_q10/datafusion:vortex-file-compressed 39144597 39485454 0.99
tpch_q11/datafusion:vortex-file-compressed 15248356 15430773 0.99
tpch_q12/datafusion:vortex-file-compressed 25864879 24832157 1.04
tpch_q13/datafusion:vortex-file-compressed 24574836 25077872 0.98
tpch_q14/datafusion:vortex-file-compressed 16871239 16713378 1.01
tpch_q15/datafusion:vortex-file-compressed 26102597 25260419 1.03
tpch_q16/datafusion:vortex-file-compressed 18966369 19607510 0.97
tpch_q17/datafusion:vortex-file-compressed 66228443 65428880 1.01
tpch_q18/datafusion:vortex-file-compressed 78000741 81327274 0.96
tpch_q19/datafusion:vortex-file-compressed 23189538 23656477 0.98
tpch_q20/datafusion:vortex-file-compressed 29166548 29795988 0.98
tpch_q21/datafusion:vortex-file-compressed 70269331 71056551 0.99
tpch_q22/datafusion:vortex-file-compressed 12126857 12382702 0.98
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58651457 57383674 1.02
tpch_q02/datafusion:vortex-compact 24643057 24989349 0.99
tpch_q03/datafusion:vortex-compact 29830264 29310720 1.02
tpch_q04/datafusion:vortex-compact 23658625 23718522 1.00
tpch_q05/datafusion:vortex-compact 50561195 50440669 1.00
tpch_q06/datafusion:vortex-compact 14480240 14398376 1.01
tpch_q07/datafusion:vortex-compact 59052412 59738955 0.99
tpch_q08/datafusion:vortex-compact 43926796 44456764 0.99
tpch_q09/datafusion:vortex-compact 56068312 55749420 1.01
tpch_q10/datafusion:vortex-compact 45908983 46877658 0.98
tpch_q11/datafusion:vortex-compact 16260373 16542204 0.98
tpch_q12/datafusion:vortex-compact 32256015 32606659 0.99
tpch_q13/datafusion:vortex-compact 30584734 30924110 0.99
tpch_q14/datafusion:vortex-compact 20953462 20093316 1.04
tpch_q15/datafusion:vortex-compact 31642968 31680044 1.00
tpch_q16/datafusion:vortex-compact 23342910 23922921 0.98
tpch_q17/datafusion:vortex-compact 68866250 67339321 1.02
tpch_q18/datafusion:vortex-compact 82833977 83166302 1.00
tpch_q19/datafusion:vortex-compact 30021121 29918032 1.00
tpch_q20/datafusion:vortex-compact 33798530 33851123 1.00
tpch_q21/datafusion:vortex-compact 78828314 78399401 1.01
tpch_q22/datafusion:vortex-compact 12602641 13162852 0.96
datafusion / parquet (0.971x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 107178799 134717887 0.80
tpch_q02/datafusion:parquet 59969915 63794279 0.94
tpch_q03/datafusion:parquet 71258717 73453983 0.97
tpch_q04/datafusion:parquet 42799939 44012166 0.97
tpch_q05/datafusion:parquet 93199876 94513607 0.99
tpch_q06/datafusion:parquet 41201226 38943843 1.06
tpch_q07/datafusion:parquet 104908285 107924865 0.97
tpch_q08/datafusion:parquet 96085819 98560970 0.97
tpch_q09/datafusion:parquet 128681075 133696480 0.96
tpch_q10/datafusion:parquet 108405569 112561418 0.96
tpch_q11/datafusion:parquet 40504484 42546924 0.95
tpch_q12/datafusion:parquet 🚨 86730308 78227821 1.11
tpch_q13/datafusion:parquet 198289244 201490588 0.98
tpch_q14/datafusion:parquet 45695775 46804562 0.98
tpch_q15/datafusion:parquet 63756463 59438127 1.07
tpch_q16/datafusion:parquet 39440791 40274784 0.98
tpch_q17/datafusion:parquet 136856304 145544737 0.94
tpch_q18/datafusion:parquet 158052935 171682469 0.92
tpch_q19/datafusion:parquet 70620068 78113357 0.90
tpch_q20/datafusion:parquet 68075686 70441691 0.97
tpch_q21/datafusion:parquet 133528023 131031216 1.02
tpch_q22/datafusion:parquet 30489362 30766141 0.99
datafusion / arrow (0.965x ➖, 3↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 50747728 52166213 0.97
tpch_q02/datafusion:arrow 18926741 19275212 0.98
tpch_q03/datafusion:arrow 29269311 30125103 0.97
tpch_q04/datafusion:arrow 24702670 24875773 0.99
tpch_q05/datafusion:arrow 76584454 73424751 1.04
tpch_q06/datafusion:arrow 21008065 19557775 1.07
tpch_q07/datafusion:arrow 100286598 101659387 0.99
tpch_q08/datafusion:arrow 40368185 43119407 0.94
tpch_q09/datafusion:arrow 62076669 64900009 0.96
tpch_q10/datafusion:arrow 45390739 46621120 0.97
tpch_q11/datafusion:arrow 9048828 9443334 0.96
tpch_q12/datafusion:arrow 50418866 50378762 1.00
tpch_q13/datafusion:arrow 47259616 47122416 1.00
tpch_q14/datafusion:arrow 21502074 21727407 0.99
tpch_q15/datafusion:arrow 40887661 44639609 0.92
tpch_q16/datafusion:arrow 18711482 19253526 0.97
tpch_q17/datafusion:arrow 🚀 66145501 73810555 0.90
tpch_q18/datafusion:arrow 131557802 138847583 0.95
tpch_q19/datafusion:arrow 🚀 34221091 38419622 0.89
tpch_q20/datafusion:arrow 🚀 33054439 37180874 0.89
tpch_q21/datafusion:arrow 150858492 161848175 0.93
tpch_q22/datafusion:arrow 17555795 18101951 0.97
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31428693 31168784 1.01
tpch_q02/duckdb:vortex-file-compressed 24380349 24276094 1.00
tpch_q03/duckdb:vortex-file-compressed 28577507 28708444 1.00
tpch_q04/duckdb:vortex-file-compressed 29800572 28604517 1.04
tpch_q05/duckdb:vortex-file-compressed 32383294 32601223 0.99
tpch_q06/duckdb:vortex-file-compressed 9895592 10088888 0.98
tpch_q07/duckdb:vortex-file-compressed 36099812 35141457 1.03
tpch_q08/duckdb:vortex-file-compressed 37763554 37542498 1.01
tpch_q09/duckdb:vortex-file-compressed 69619616 73596485 0.95
tpch_q10/duckdb:vortex-file-compressed 33495555 34014292 0.98
tpch_q11/duckdb:vortex-file-compressed 13769000 13852142 0.99
tpch_q12/duckdb:vortex-file-compressed 21395234 21294022 1.00
tpch_q13/duckdb:vortex-file-compressed 34556962 34476561 1.00
tpch_q14/duckdb:vortex-file-compressed 21257317 20268196 1.05
tpch_q15/duckdb:vortex-file-compressed 16144230 16350648 0.99
tpch_q16/duckdb:vortex-file-compressed 28137036 27503559 1.02
tpch_q17/duckdb:vortex-file-compressed 23984027 24299533 0.99
tpch_q18/duckdb:vortex-file-compressed 48908986 49104405 1.00
tpch_q19/duckdb:vortex-file-compressed 28476795 27822465 1.02
tpch_q20/duckdb:vortex-file-compressed 33130608 33691238 0.98
tpch_q21/duckdb:vortex-file-compressed 103667306 102050220 1.02
tpch_q22/duckdb:vortex-file-compressed 16789675 16418548 1.02
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37303930 38244008 0.98
tpch_q02/duckdb:vortex-compact 36007765 35335020 1.02
tpch_q03/duckdb:vortex-compact 32373194 31687393 1.02
tpch_q04/duckdb:vortex-compact 34591947 33340008 1.04
tpch_q05/duckdb:vortex-compact 37476972 36695301 1.02
tpch_q06/duckdb:vortex-compact 15101550 14737059 1.02
tpch_q07/duckdb:vortex-compact 41528624 41226591 1.01
tpch_q08/duckdb:vortex-compact 44323853 45030179 0.98
tpch_q09/duckdb:vortex-compact 81090903 82157012 0.99
tpch_q10/duckdb:vortex-compact 38256132 39150993 0.98
tpch_q11/duckdb:vortex-compact 19695894 18677119 1.05
tpch_q12/duckdb:vortex-compact 35021286 35056311 1.00
tpch_q13/duckdb:vortex-compact 43749477 43590649 1.00
tpch_q14/duckdb:vortex-compact 29342709 27514145 1.07
tpch_q15/duckdb:vortex-compact 18966891 19265930 0.98
tpch_q16/duckdb:vortex-compact 34835602 34374948 1.01
tpch_q17/duckdb:vortex-compact 29607109 29651047 1.00
tpch_q18/duckdb:vortex-compact 49535746 50691885 0.98
tpch_q19/duckdb:vortex-compact 34482027 33468941 1.03
tpch_q20/duckdb:vortex-compact 41643856 41559748 1.00
tpch_q21/duckdb:vortex-compact 111829561 109025323 1.03
tpch_q22/duckdb:vortex-compact 19440849 19988971 0.97
duckdb / parquet (1.007x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 76281733 77599727 0.98
tpch_q02/duckdb:parquet 38521890 39181181 0.98
tpch_q03/duckdb:parquet 68479899 70168585 0.98
tpch_q04/duckdb:parquet 46828465 46787135 1.00
tpch_q05/duckdb:parquet 64469654 65906886 0.98
tpch_q06/duckdb:parquet 20574275 20509452 1.00
tpch_q07/duckdb:parquet 🚨 78121662 69979188 1.12
tpch_q08/duckdb:parquet 81884034 83467549 0.98
tpch_q09/duckdb:parquet 142968924 136826896 1.04
tpch_q10/duckdb:parquet 123045150 123778669 0.99
tpch_q11/duckdb:parquet 21369525 21020714 1.02
tpch_q12/duckdb:parquet 44927281 45145857 1.00
tpch_q13/duckdb:parquet 247612844 248620677 1.00
tpch_q14/duckdb:parquet 55833200 52001259 1.07
tpch_q15/duckdb:parquet 24195701 24262226 1.00
tpch_q16/duckdb:parquet 55423403 55637050 1.00
tpch_q17/duckdb:parquet 53661461 52922457 1.01
tpch_q18/duckdb:parquet 112297558 113785357 0.99
tpch_q19/duckdb:parquet 67512283 67292427 1.00
tpch_q20/duckdb:parquet 63711291 61655624 1.03
tpch_q21/duckdb:parquet 162337862 162715588 1.00
tpch_q22/duckdb:parquet 51587838 51679329 1.00
duckdb / duckdb (1.021x ➖, 0↑ 2↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16009625 15887057 1.01
tpch_q02/duckdb:duckdb 12583171 12333865 1.02
tpch_q03/duckdb:duckdb 19925710 18744796 1.06
tpch_q04/duckdb:duckdb 🚨 19837444 17817361 1.11
tpch_q05/duckdb:duckdb 19598943 20162126 0.97
tpch_q06/duckdb:duckdb 5440299 5289220 1.03
tpch_q07/duckdb:duckdb 22363838 22236785 1.01
tpch_q08/duckdb:duckdb 20552209 20721919 0.99
tpch_q09/duckdb:duckdb 52713051 53323763 0.99
tpch_q10/duckdb:duckdb 43762895 44135420 0.99
tpch_q11/duckdb:duckdb 5846502 5703305 1.03
tpch_q12/duckdb:duckdb 13655973 13641030 1.00
tpch_q13/duckdb:duckdb 37822735 37657787 1.00
tpch_q14/duckdb:duckdb 🚨 18385146 16128704 1.14
tpch_q15/duckdb:duckdb 11904980 11727243 1.02
tpch_q16/duckdb:duckdb 23202738 23179079 1.00
tpch_q17/duckdb:duckdb 13936214 13466934 1.03
tpch_q18/duckdb:duckdb 38063849 38786181 0.98
tpch_q19/duckdb:duckdb 27353261 25983440 1.05
tpch_q20/duckdb:duckdb 22360227 22357898 1.00
tpch_q21/duckdb:duckdb 56914925 56197333 1.01
tpch_q22/duckdb:duckdb 24643871 24229380 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.7% -11.6% +10.0% +19.1% ➖ noise
1 datafusion:vortex-compact +2.2% -11.6% +15.6% +16.4% ➖ noise
1 datafusion:vortex-file-compressed +3.5% -11.6% +17.0% +16.6% 🚨 regression
1 duckdb:duckdb +0.8% -11.6% +14.0% +16.0% ➖ noise
1 duckdb:vortex-compact -2.5% -11.6% +10.3% +14.9% ➖ noise
1 duckdb:vortex-file-compressed +0.8% -11.6% +14.0% +19.9% ➖ noise
2 datafusion:arrow -1.8% -3.9% +2.1% +10.0% ➖ noise
2 datafusion:vortex-compact -1.4% -3.9% +2.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% -3.9% +1.2% +10.0% ➖ noise
2 duckdb:duckdb +2.0% -3.9% +6.1% +10.0% ➖ noise
2 duckdb:vortex-compact +1.9% -3.9% +6.0% +10.2% ➖ noise
2 duckdb:vortex-file-compressed +0.4% -3.9% +4.5% +10.0% ➖ noise
3 datafusion:arrow -2.8% -2.7% -0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +1.8% -2.7% +4.6% +11.2% ➖ noise
3 datafusion:vortex-file-compressed +0.8% -2.7% +3.6% +11.6% ➖ noise
3 duckdb:duckdb +6.3% -2.7% +9.2% +11.0% ➖ noise
3 duckdb:vortex-compact +2.2% -2.7% +5.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% -2.7% +2.3% +14.6% ➖ noise
4 datafusion:arrow -0.7% -1.3% +0.7% +10.0% ➖ noise
4 datafusion:vortex-compact -0.3% -1.3% +1.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.4% -1.3% -2.1% +12.8% ➖ noise
4 duckdb:duckdb +11.3% -1.3% +12.9% +10.0% 🚨 regression
4 duckdb:vortex-compact +3.8% -1.3% +5.2% +10.5% ➖ noise
4 duckdb:vortex-file-compressed +4.2% -1.3% +5.6% +10.0% ➖ noise
5 datafusion:arrow +4.3% -1.8% +6.2% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% -1.8% +2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.3% -1.8% +2.2% +10.0% ➖ noise
5 duckdb:duckdb -2.8% -1.8% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +2.1% -1.8% +4.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.7% -1.8% +1.1% +13.1% ➖ noise
6 datafusion:arrow +7.4% +3.0% +4.3% +16.3% ➖ noise
6 datafusion:vortex-compact +0.6% +3.0% -2.4% +14.5% ➖ noise
6 datafusion:vortex-file-compressed +5.2% +3.0% +2.1% +13.4% ➖ noise
6 duckdb:duckdb +2.9% +3.0% -0.2% +16.2% ➖ noise
6 duckdb:vortex-compact +2.5% +3.0% -0.5% +19.7% ➖ noise
6 duckdb:vortex-file-compressed -1.9% +3.0% -4.8% +17.5% ➖ noise
7 datafusion:arrow -1.4% +4.2% -5.3% +10.9% ➖ noise
7 datafusion:vortex-compact -1.1% +4.2% -5.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.1% +4.2% -2.9% +10.0% ➖ noise
7 duckdb:duckdb +0.6% +4.2% -3.5% +12.2% ➖ noise
7 duckdb:vortex-compact +0.7% +4.2% -3.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.7% +4.2% -1.4% +10.0% ➖ noise
8 datafusion:arrow -6.4% -2.2% -4.3% +10.0% ➖ noise
8 datafusion:vortex-compact -1.2% -2.2% +1.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
8 duckdb:duckdb -0.8% -2.2% +1.4% +10.0% ➖ noise
8 duckdb:vortex-compact -1.6% -2.2% +0.7% +10.4% ➖ noise
8 duckdb:vortex-file-compressed +0.6% -2.2% +2.9% +11.5% ➖ noise
9 datafusion:arrow -4.4% +0.3% -4.6% +10.0% ➖ noise
9 datafusion:vortex-compact +0.6% +0.3% +0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.1% +0.3% -1.4% +10.0% ➖ noise
9 duckdb:duckdb -1.1% +0.3% -1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -1.3% +0.3% -1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.4% +0.3% -5.7% +10.0% ➖ noise
10 datafusion:arrow -2.6% -2.2% -0.5% +10.0% ➖ noise
10 datafusion:vortex-compact -2.1% -2.2% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.9% -2.2% +1.3% +10.0% ➖ noise
10 duckdb:duckdb -0.8% -2.2% +1.3% +10.0% ➖ noise
10 duckdb:vortex-compact -2.3% -2.2% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.5% -2.2% +0.6% +10.0% ➖ noise
11 datafusion:arrow -4.2% -1.6% -2.6% +10.0% ➖ noise
11 datafusion:vortex-compact -1.7% -1.6% -0.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.2% -1.6% +0.4% +10.0% ➖ noise
11 duckdb:duckdb +2.5% -1.6% +4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +5.5% -1.6% +7.2% +15.0% ➖ noise
11 duckdb:vortex-file-compressed -0.6% -1.6% +1.0% +17.5% ➖ noise
12 datafusion:arrow +0.1% +5.0% -4.7% +19.9% ➖ noise
12 datafusion:vortex-compact -1.1% +5.0% -5.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.2% +5.0% -0.8% +14.2% ➖ noise
12 duckdb:duckdb +0.1% +5.0% -4.7% +10.1% ➖ noise
12 duckdb:vortex-compact -0.1% +5.0% -4.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.5% +5.0% -4.3% +12.3% ➖ noise
13 datafusion:arrow +0.3% -1.0% +1.3% +10.0% ➖ noise
13 datafusion:vortex-compact -1.1% -1.0% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.0% -1.0% -1.0% +10.0% ➖ noise
13 duckdb:duckdb +0.4% -1.0% +1.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% -1.0% +1.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.2% -1.0% +1.2% +10.0% ➖ noise
14 datafusion:arrow -1.0% +2.4% -3.3% +11.7% ➖ noise
14 datafusion:vortex-compact +4.3% +2.4% +1.9% +11.5% ➖ noise
14 datafusion:vortex-file-compressed +0.9% +2.4% -1.4% +11.3% ➖ noise
14 duckdb:duckdb +14.0% +2.4% +11.3% +16.5% ➖ noise
14 duckdb:vortex-compact +6.6% +2.4% +4.2% +10.3% ➖ noise
14 duckdb:vortex-file-compressed +4.9% +2.4% +2.4% +14.6% ➖ noise
15 datafusion:arrow -8.4% +3.4% -11.4% +11.8% ✅ faster
15 datafusion:vortex-compact -0.1% +3.4% -3.4% +13.6% ➖ noise
15 datafusion:vortex-file-compressed +3.3% +3.4% -0.1% +12.1% ➖ noise
15 duckdb:duckdb +1.5% +3.4% -1.8% +14.1% ➖ noise
15 duckdb:vortex-compact -1.6% +3.4% -4.8% +15.4% ➖ noise
15 duckdb:vortex-file-compressed -1.3% +3.4% -4.5% +12.3% ➖ noise
16 datafusion:arrow -2.8% -1.2% -1.6% +10.0% ➖ noise
16 datafusion:vortex-compact -2.4% -1.2% -1.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.3% -1.2% -2.1% +10.1% ➖ noise
16 duckdb:duckdb +0.1% -1.2% +1.3% +10.0% ➖ noise
16 duckdb:vortex-compact +1.3% -1.2% +2.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.3% -1.2% +3.6% +10.0% ➖ noise
17 datafusion:arrow -10.4% -2.4% -8.2% +12.8% ➖ noise
17 datafusion:vortex-compact +2.3% -2.4% +4.7% +10.2% ➖ noise
17 datafusion:vortex-file-compressed +1.2% -2.4% +3.7% +10.3% ➖ noise
17 duckdb:duckdb +3.5% -2.4% +6.0% +11.3% ➖ noise
17 duckdb:vortex-compact -0.1% -2.4% +2.3% +10.9% ➖ noise
17 duckdb:vortex-file-compressed -1.3% -2.4% +1.1% +14.0% ➖ noise
18 datafusion:arrow -5.3% -4.7% -0.6% +10.0% ➖ noise
18 datafusion:vortex-compact -0.4% -4.7% +4.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -4.1% -4.7% +0.6% +10.0% ➖ noise
18 duckdb:duckdb -1.9% -4.7% +3.0% +10.0% ➖ noise
18 duckdb:vortex-compact -2.3% -4.7% +2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.4% -4.7% +4.5% +10.0% ➖ noise
19 datafusion:arrow -10.9% -4.8% -6.5% +11.8% ➖ noise
19 datafusion:vortex-compact +0.3% -4.8% +5.4% +10.2% ➖ noise
19 datafusion:vortex-file-compressed -2.0% -4.8% +2.9% +10.3% ➖ noise
19 duckdb:duckdb +5.3% -4.8% +10.5% +13.0% ➖ noise
19 duckdb:vortex-compact +3.0% -4.8% +8.2% +10.1% ➖ noise
19 duckdb:vortex-file-compressed +2.4% -4.8% +7.5% +11.6% ➖ noise
20 datafusion:arrow -11.1% -0.1% -11.0% +10.0% ✅ faster
20 datafusion:vortex-compact -0.2% -0.1% -0.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% -0.1% -2.0% +10.5% ➖ noise
20 duckdb:duckdb +0.0% -0.1% +0.1% +10.0% ➖ noise
20 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.7% -0.1% -1.6% +10.0% ➖ noise
21 datafusion:arrow -6.8% +0.8% -7.6% +10.0% ➖ noise
21 datafusion:vortex-compact +0.5% +0.8% -0.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.1% +0.8% -1.9% +10.0% ➖ noise
21 duckdb:duckdb +1.3% +0.8% +0.4% +10.0% ➖ noise
21 duckdb:vortex-compact +2.6% +0.8% +1.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.6% +0.8% +0.7% +10.0% ➖ noise
22 datafusion:arrow -3.0% -0.5% -2.5% +10.0% ➖ noise
22 datafusion:vortex-compact -4.3% -0.5% -3.7% +11.0% ➖ noise
22 datafusion:vortex-file-compressed -2.1% -0.5% -1.5% +10.0% ➖ noise
22 duckdb:duckdb +1.7% -0.5% +2.3% +10.0% ➖ noise
22 duckdb:vortex-compact -2.7% -0.5% -2.2% +13.8% ➖ noise
22 duckdb:vortex-file-compressed +2.3% -0.5% +2.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.918x ➖
Parquet (geomean): 0.939x ➖
Shifts: Parquet (control) -6.1% · Median polish -6.4%


duckdb / vortex-file-compressed (0.907x ➖, 2↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚀 11709929 13138546 0.89
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20743895 28645375 0.72
statpopgen_q02/duckdb:vortex-file-compressed 1393884626 1490223951 0.94
statpopgen_q03/duckdb:vortex-file-compressed 3130701658 3379768658 0.93
statpopgen_q04/duckdb:vortex-file-compressed 3097904477 3381050799 0.92
statpopgen_q05/duckdb:vortex-file-compressed 1443688812 1550224216 0.93
statpopgen_q06/duckdb:vortex-file-compressed 2145165967 2250346647 0.95
statpopgen_q07/duckdb:vortex-file-compressed 209418996 230528956 0.91
statpopgen_q08/duckdb:vortex-file-compressed 251105830 277126613 0.91
statpopgen_q09/duckdb:vortex-file-compressed 2967296914 3062094875 0.97
statpopgen_q10/duckdb:vortex-file-compressed 4730770970 5048170443 0.94
duckdb / vortex-compact (0.931x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11421633 12477185 0.92
statpopgen_q01/duckdb:vortex-compact 168229393 173372613 0.97
statpopgen_q02/duckdb:vortex-compact 1830120291 1956992830 0.94
statpopgen_q03/duckdb:vortex-compact 3623235539 3787180629 0.96
statpopgen_q04/duckdb:vortex-compact 3540343264 3783165115 0.94
statpopgen_q05/duckdb:vortex-compact 1836798300 1994656916 0.92
statpopgen_q06/duckdb:vortex-compact 2686285171 2831688533 0.95
statpopgen_q07/duckdb:vortex-compact 893601245 960042160 0.93
statpopgen_q08/duckdb:vortex-compact 929094087 993251277 0.94
statpopgen_q09/duckdb:vortex-compact 🚀 3325017452 3766658817 0.88
statpopgen_q10/duckdb:vortex-compact 5427019499 5984214170 0.91
duckdb / parquet (0.939x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 329470968 350820505 0.94
statpopgen_q01/duckdb:parquet 410866284 437390373 0.94
statpopgen_q02/duckdb:parquet 1003700967 1067675729 0.94
statpopgen_q03/duckdb:parquet 1509278479 1572013368 0.96
statpopgen_q04/duckdb:parquet 1514212148 1569236478 0.96
statpopgen_q05/duckdb:parquet 1015477368 1104825985 0.92
statpopgen_q06/duckdb:parquet 1502089229 1605675764 0.94
statpopgen_q07/duckdb:parquet 1295483119 1401897691 0.92
statpopgen_q08/duckdb:parquet 1320423948 1402815958 0.94
statpopgen_q09/duckdb:parquet 1384618176 1464728855 0.95
statpopgen_q10/duckdb:parquet 2684735978 2911642520 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -8.5% -6.1% -2.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -10.9% -6.1% -5.1% +15.4% ➖ noise
1 duckdb:vortex-compact -3.0% -6.1% +3.3% +23.9% ➖ noise
1 duckdb:vortex-file-compressed -27.6% -6.1% -22.9% +191.8% ➖ noise
2 duckdb:vortex-compact -6.5% -6.0% -0.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -6.5% -6.0% -0.5% +10.0% ➖ noise
3 duckdb:vortex-compact -4.3% -4.0% -0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.4% -4.0% -3.5% +10.0% ➖ noise
4 duckdb:vortex-compact -6.4% -3.5% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -8.4% -3.5% -5.0% +10.0% ➖ noise
5 duckdb:vortex-compact -7.9% -8.1% +0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.9% -8.1% +1.3% +10.0% ➖ noise
6 duckdb:vortex-compact -5.1% -6.5% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.7% -6.5% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact -6.9% -7.6% +0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -9.2% -7.6% -1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -6.5% -5.9% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -9.4% -5.9% -3.7% +10.0% ➖ noise
9 duckdb:vortex-compact -11.7% -5.5% -6.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% -5.5% +2.5% +10.0% ➖ noise
10 duckdb:vortex-compact -9.3% -7.8% -1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.3% -7.8% +1.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -1.1%


datafusion / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 386541966 392379111 0.99
tpch_q02/datafusion:vortex-file-compressed 105241902 108202436 0.97
tpch_q03/datafusion:vortex-file-compressed 213318335 216489356 0.99
tpch_q04/datafusion:vortex-file-compressed 112462460 114579095 0.98
tpch_q05/datafusion:vortex-file-compressed 365529638 370825626 0.99
tpch_q06/datafusion:vortex-file-compressed 42652910 44204209 0.96
tpch_q07/datafusion:vortex-file-compressed 492308536 503548531 0.98
tpch_q08/datafusion:vortex-file-compressed 351595152 357990022 0.98
tpch_q09/datafusion:vortex-file-compressed 618425649 633719036 0.98
tpch_q10/datafusion:vortex-file-compressed 227255682 229160328 0.99
tpch_q11/datafusion:vortex-file-compressed 80247746 82821204 0.97
tpch_q12/datafusion:vortex-file-compressed 116944442 121249106 0.96
tpch_q13/datafusion:vortex-file-compressed 208943361 213806930 0.98
tpch_q14/datafusion:vortex-file-compressed 55903872 56466535 0.99
tpch_q15/datafusion:vortex-file-compressed 104806627 105314877 1.00
tpch_q16/datafusion:vortex-file-compressed 73640003 75561677 0.97
tpch_q17/datafusion:vortex-file-compressed 619543808 630973611 0.98
tpch_q18/datafusion:vortex-file-compressed 824874494 841693262 0.98
tpch_q19/datafusion:vortex-file-compressed 88057001 92360981 0.95
tpch_q20/datafusion:vortex-file-compressed 162865225 166176823 0.98
tpch_q21/datafusion:vortex-file-compressed 641291124 657901287 0.97
tpch_q22/datafusion:vortex-file-compressed 64203284 64262207 1.00
datafusion / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435974772 431725137 1.01
tpch_q02/datafusion:vortex-compact 107400415 109818603 0.98
tpch_q03/datafusion:vortex-compact 213839654 216869639 0.99
tpch_q04/datafusion:vortex-compact 119947374 121557540 0.99
tpch_q05/datafusion:vortex-compact 371157952 374410032 0.99
tpch_q06/datafusion:vortex-compact 64076955 65060826 0.98
tpch_q07/datafusion:vortex-compact 514088508 523425623 0.98
tpch_q08/datafusion:vortex-compact 359248441 361997486 0.99
tpch_q09/datafusion:vortex-compact 628719215 633033795 0.99
tpch_q10/datafusion:vortex-compact 243729135 246886101 0.99
tpch_q11/datafusion:vortex-compact 81962059 83081704 0.99
tpch_q12/datafusion:vortex-compact 162537732 165580227 0.98
tpch_q13/datafusion:vortex-compact 257310885 264948931 0.97
tpch_q14/datafusion:vortex-compact 72769880 75019143 0.97
tpch_q15/datafusion:vortex-compact 157904169 160759576 0.98
tpch_q16/datafusion:vortex-compact 78717287 77879552 1.01
tpch_q17/datafusion:vortex-compact 626086601 633171010 0.99
tpch_q18/datafusion:vortex-compact 828322338 842748892 0.98
tpch_q19/datafusion:vortex-compact 130861744 135588112 0.97
tpch_q20/datafusion:vortex-compact 188259905 191145222 0.98
tpch_q21/datafusion:vortex-compact 648736575 659733594 0.98
tpch_q22/datafusion:vortex-compact 72024844 71950119 1.00
datafusion / parquet (0.985x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 462343470 463146752 1.00
tpch_q02/datafusion:parquet 167393898 171587364 0.98
tpch_q03/datafusion:parquet 270818272 276660075 0.98
tpch_q04/datafusion:parquet 122367855 125530650 0.97
tpch_q05/datafusion:parquet 422414394 430060947 0.98
tpch_q06/datafusion:parquet 117474843 127456576 0.92
tpch_q07/datafusion:parquet 593325533 601620660 0.99
tpch_q08/datafusion:parquet 448889001 455851320 0.98
tpch_q09/datafusion:parquet 726731746 734355391 0.99
tpch_q10/datafusion:parquet 484656652 495829550 0.98
tpch_q11/datafusion:parquet 115146414 115479631 1.00
tpch_q12/datafusion:parquet 192419682 191235616 1.01
tpch_q13/datafusion:parquet 331394537 333668817 0.99
tpch_q14/datafusion:parquet 158003435 156875540 1.01
tpch_q15/datafusion:parquet 242192725 244714433 0.99
tpch_q16/datafusion:parquet 119558365 122099002 0.98
tpch_q17/datafusion:parquet 664709119 671895735 0.99
tpch_q18/datafusion:parquet 871664755 878510990 0.99
tpch_q19/datafusion:parquet 250437922 252659875 0.99
tpch_q20/datafusion:parquet 283204511 290051594 0.98
tpch_q21/datafusion:parquet 676863245 686952113 0.99
tpch_q22/datafusion:parquet 210606117 213580185 0.99
datafusion / arrow (0.990x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 589414322 587984182 1.00
tpch_q02/datafusion:arrow 161936740 164873229 0.98
tpch_q03/datafusion:arrow 455569318 462288995 0.99
tpch_q04/datafusion:arrow 337434707 348179427 0.97
tpch_q05/datafusion:arrow 923098835 930823663 0.99
tpch_q06/datafusion:arrow 273923651 281982606 0.97
tpch_q07/datafusion:arrow 1157240416 1151385784 1.01
tpch_q08/datafusion:arrow 1134312559 1127849310 1.01
tpch_q09/datafusion:arrow 1342849877 1344045978 1.00
tpch_q10/datafusion:arrow 583287111 584901992 1.00
tpch_q11/datafusion:arrow 136691363 138042705 0.99
tpch_q12/datafusion:arrow 727700449 760981518 0.96
tpch_q13/datafusion:arrow 503716745 500708887 1.01
tpch_q14/datafusion:arrow 315425016 313089489 1.01
tpch_q15/datafusion:arrow 691624807 688153501 1.01
tpch_q16/datafusion:arrow 104461264 103261130 1.01
tpch_q17/datafusion:arrow 1310473758 1316263569 1.00
tpch_q18/datafusion:arrow 1855301985 1911787146 0.97
tpch_q19/datafusion:arrow 485427129 495439598 0.98
tpch_q20/datafusion:arrow 478422512 492236001 0.97
tpch_q21/datafusion:arrow 2983224330 2989287494 1.00
tpch_q22/datafusion:arrow 128550673 132225851 0.97
duckdb / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169526067 170916239 0.99
tpch_q02/duckdb:vortex-file-compressed 50687347 50385964 1.01
tpch_q03/duckdb:vortex-file-compressed 122842253 125254572 0.98
tpch_q04/duckdb:vortex-file-compressed 148375696 152469422 0.97
tpch_q05/duckdb:vortex-file-compressed 128858738 126028246 1.02
tpch_q06/duckdb:vortex-file-compressed 45539233 48268030 0.94
tpch_q07/duckdb:vortex-file-compressed 141578966 142597840 0.99
tpch_q08/duckdb:vortex-file-compressed 167298179 166792539 1.00
tpch_q09/duckdb:vortex-file-compressed 319175640 321482220 0.99
tpch_q10/duckdb:vortex-file-compressed 141094460 142753449 0.99
tpch_q11/duckdb:vortex-file-compressed 32736484 33632440 0.97
tpch_q12/duckdb:vortex-file-compressed 93534525 92380023 1.01
tpch_q13/duckdb:vortex-file-compressed 225189942 229124559 0.98
tpch_q14/duckdb:vortex-file-compressed 66260988 65752869 1.01
tpch_q15/duckdb:vortex-file-compressed 86528855 86887201 1.00
tpch_q16/duckdb:vortex-file-compressed 77545390 78884779 0.98
tpch_q17/duckdb:vortex-file-compressed 95686904 97230317 0.98
tpch_q18/duckdb:vortex-file-compressed 288486121 287792107 1.00
tpch_q19/duckdb:vortex-file-compressed 83209841 84007730 0.99
tpch_q20/duckdb:vortex-file-compressed 156286928 156426045 1.00
tpch_q21/duckdb:vortex-file-compressed 560410626 563453907 0.99
tpch_q22/duckdb:vortex-file-compressed 70040025 71001074 0.99
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 226978321 228132790 0.99
tpch_q02/duckdb:vortex-compact 54525557 55468855 0.98
tpch_q03/duckdb:vortex-compact 136329290 138623586 0.98
tpch_q04/duckdb:vortex-compact 170656584 171500316 1.00
tpch_q05/duckdb:vortex-compact 142038839 143974304 0.99
tpch_q06/duckdb:vortex-compact 82393001 83506806 0.99
tpch_q07/duckdb:vortex-compact 196198597 196252792 1.00
tpch_q08/duckdb:vortex-compact 183933093 185353912 0.99
tpch_q09/duckdb:vortex-compact 349631698 351008990 1.00
tpch_q10/duckdb:vortex-compact 175782478 175977672 1.00
tpch_q11/duckdb:vortex-compact 39737337 39994431 0.99
tpch_q12/duckdb:vortex-compact 199608921 200940047 0.99
tpch_q13/duckdb:vortex-compact 274216983 278006477 0.99
tpch_q14/duckdb:vortex-compact 96963885 98342815 0.99
tpch_q15/duckdb:vortex-compact 111281624 112293249 0.99
tpch_q16/duckdb:vortex-compact 82674012 83733965 0.99
tpch_q17/duckdb:vortex-compact 111032753 113069427 0.98
tpch_q18/duckdb:vortex-compact 291823421 288651353 1.01
tpch_q19/duckdb:vortex-compact 107240682 106458102 1.01
tpch_q20/duckdb:vortex-compact 199239629 201630373 0.99
tpch_q21/duckdb:vortex-compact 606831885 613669412 0.99
tpch_q22/duckdb:vortex-compact 84634549 85394719 0.99
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258851095 258208878 1.00
tpch_q02/duckdb:parquet 99676500 95814127 1.04
tpch_q03/duckdb:parquet 207107433 205821089 1.01
tpch_q04/duckdb:parquet 134059898 136492186 0.98
tpch_q05/duckdb:parquet 213440395 215316465 0.99
tpch_q06/duckdb:parquet 64560686 65387250 0.99
tpch_q07/duckdb:parquet 178565689 183108775 0.98
tpch_q08/duckdb:parquet 250147594 252357670 0.99
tpch_q09/duckdb:parquet 483791375 482626546 1.00
tpch_q10/duckdb:parquet 608793406 610946636 1.00
tpch_q11/duckdb:parquet 55332271 58682955 0.94
tpch_q12/duckdb:parquet 123400088 121099085 1.02
tpch_q13/duckdb:parquet 440414957 449095570 0.98
tpch_q14/duckdb:parquet 174473802 174228163 1.00
tpch_q15/duckdb:parquet 95276937 95083279 1.00
tpch_q16/duckdb:parquet 162881439 160714191 1.01
tpch_q17/duckdb:parquet 176233979 175825828 1.00
tpch_q18/duckdb:parquet 351685265 351986122 1.00
tpch_q19/duckdb:parquet 280898099 286014243 0.98
tpch_q20/duckdb:parquet 226396977 225256768 1.01
tpch_q21/duckdb:parquet 553978218 559086481 0.99
tpch_q22/duckdb:parquet 288770256 291952278 0.99
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116923786 117099782 1.00
tpch_q02/duckdb:duckdb 47504336 45592705 1.04
tpch_q03/duckdb:duckdb 97214444 96475138 1.01
tpch_q04/duckdb:duckdb 132101364 132534160 1.00
tpch_q05/duckdb:duckdb 111136264 108857085 1.02
tpch_q06/duckdb:duckdb 37042401 37043427 1.00
tpch_q07/duckdb:duckdb 85773009 86221321 0.99
tpch_q08/duckdb:duckdb 110097727 111012147 0.99
tpch_q09/duckdb:duckdb 276532282 272791553 1.01
tpch_q10/duckdb:duckdb 200836970 202683657 0.99
tpch_q11/duckdb:duckdb 15787480 15694107 1.01
tpch_q12/duckdb:duckdb 83901864 85448174 0.98
tpch_q13/duckdb:duckdb 218904556 222607816 0.98
tpch_q14/duckdb:duckdb 69715477 71077096 0.98
tpch_q15/duckdb:duckdb 76889975 78093454 0.98
tpch_q16/duckdb:duckdb 73009551 74175508 0.98
tpch_q17/duckdb:duckdb 84676867 84829355 1.00
tpch_q18/duckdb:duckdb 212340620 211914928 1.00
tpch_q19/duckdb:duckdb 116802251 116624892 1.00
tpch_q20/duckdb:duckdb 111913789 113033887 0.99
tpch_q21/duckdb:duckdb 294047790 296838434 0.99
tpch_q22/duckdb:duckdb 66372111 68793945 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.2% +0.0% +0.2% +10.0% ➖ noise
1 datafusion:vortex-compact +1.0% +0.0% +0.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.5% +0.0% -1.5% +10.0% ➖ noise
1 duckdb:duckdb -0.2% +0.0% -0.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.5% +0.0% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% +0.0% -0.9% +10.0% ➖ noise
2 datafusion:arrow -1.8% +0.7% -2.5% +10.0% ➖ noise
2 datafusion:vortex-compact -2.2% +0.7% -2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.7% +0.7% -3.5% +10.0% ➖ noise
2 duckdb:duckdb +4.2% +0.7% +3.4% +10.0% ➖ noise
2 duckdb:vortex-compact -1.7% +0.7% -2.4% +12.7% ➖ noise
2 duckdb:vortex-file-compressed +0.6% +0.7% -0.1% +10.0% ➖ noise
3 datafusion:arrow -1.5% -0.8% -0.7% +10.0% ➖ noise
3 datafusion:vortex-compact -1.4% -0.8% -0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.5% -0.8% -0.7% +10.0% ➖ noise
3 duckdb:duckdb +0.8% -0.8% +1.5% +10.0% ➖ noise
3 duckdb:vortex-compact -1.7% -0.8% -0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -0.8% -1.2% +10.0% ➖ noise
4 datafusion:arrow -3.1% -2.2% -1.0% +10.0% ➖ noise
4 datafusion:vortex-compact -1.3% -2.2% +0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.8% -2.2% +0.3% +10.0% ➖ noise
4 duckdb:duckdb -0.3% -2.2% +1.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% -2.2% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.7% -2.2% -0.5% +10.0% ➖ noise
5 datafusion:arrow -0.8% -1.3% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -0.9% -1.3% +0.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% -1.3% -0.1% +10.0% ➖ noise
5 duckdb:duckdb +2.1% -1.3% +3.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.3% -1.3% -0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% -1.3% +3.6% +10.0% ➖ noise
6 datafusion:arrow -2.9% -4.6% +1.8% +10.0% ➖ noise
6 datafusion:vortex-compact -1.5% -4.6% +3.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.5% -4.6% +1.1% +10.0% ➖ noise
6 duckdb:duckdb -0.0% -4.6% +4.8% +10.7% ➖ noise
6 duckdb:vortex-compact -1.3% -4.6% +3.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -5.7% -4.6% -1.1% +13.2% ➖ noise
7 datafusion:arrow +0.5% -1.9% +2.5% +10.0% ➖ noise
7 datafusion:vortex-compact -1.8% -1.9% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.2% -1.9% -0.3% +10.0% ➖ noise
7 duckdb:duckdb -0.5% -1.9% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% -1.9% +1.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -1.9% +1.2% +10.0% ➖ noise
8 datafusion:arrow +0.6% -1.2% +1.8% +10.0% ➖ noise
8 datafusion:vortex-compact -0.8% -1.2% +0.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.8% -1.2% -0.6% +10.0% ➖ noise
8 duckdb:duckdb -0.8% -1.2% +0.4% +10.0% ➖ noise
8 duckdb:vortex-compact -0.8% -1.2% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -1.2% +1.5% +10.0% ➖ noise
9 datafusion:arrow -0.1% -0.4% +0.3% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -0.4% -0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.4% -0.4% -2.0% +10.0% ➖ noise
9 duckdb:duckdb +1.4% -0.4% +1.8% +10.0% ➖ noise
9 duckdb:vortex-compact -0.4% -0.4% +0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% -0.4% -0.3% +10.0% ➖ noise
10 datafusion:arrow -0.3% -1.3% +1.0% +10.0% ➖ noise
10 datafusion:vortex-compact -1.3% -1.3% +0.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
10 duckdb:duckdb -0.9% -1.3% +0.4% +10.0% ➖ noise
10 duckdb:vortex-compact -0.1% -1.3% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.2% -1.3% +0.1% +10.0% ➖ noise
11 datafusion:arrow -1.0% -3.0% +2.1% +10.0% ➖ noise
11 datafusion:vortex-compact -1.3% -3.0% +1.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.1% -3.0% -0.1% +10.0% ➖ noise
11 duckdb:duckdb +0.6% -3.0% +3.7% +11.6% ➖ noise
11 duckdb:vortex-compact -0.6% -3.0% +2.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -2.7% -3.0% +0.4% +10.0% ➖ noise
12 datafusion:arrow -4.4% +1.3% -5.6% +32.3% ➖ noise
12 datafusion:vortex-compact -1.8% +1.3% -3.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.6% +1.3% -4.7% +10.0% ➖ noise
12 duckdb:duckdb -1.8% +1.3% -3.0% +10.0% ➖ noise
12 duckdb:vortex-compact -0.7% +1.3% -1.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.2% +1.3% -0.0% +10.0% ➖ noise
13 datafusion:arrow +0.6% -1.3% +1.9% +10.0% ➖ noise
13 datafusion:vortex-compact -2.9% -1.3% -1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.3% -1.3% -1.0% +10.0% ➖ noise
13 duckdb:duckdb -1.7% -1.3% -0.4% +10.0% ➖ noise
13 duckdb:vortex-compact -1.4% -1.3% -0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.7% -1.3% -0.4% +10.0% ➖ noise
14 datafusion:arrow +0.7% +0.4% +0.3% +10.0% ➖ noise
14 datafusion:vortex-compact -3.0% +0.4% -3.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.0% +0.4% -1.4% +10.0% ➖ noise
14 duckdb:duckdb -1.9% +0.4% -2.3% +10.0% ➖ noise
14 duckdb:vortex-compact -1.4% +0.4% -1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.8% +0.4% +0.3% +10.0% ➖ noise
15 datafusion:arrow +0.5% -0.4% +0.9% +10.0% ➖ noise
15 datafusion:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
15 duckdb:duckdb -1.5% -0.4% -1.1% +10.0% ➖ noise
15 duckdb:vortex-compact -0.9% -0.4% -0.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -0.4% +0.0% +10.0% ➖ noise
16 datafusion:arrow +1.2% -0.4% +1.5% +10.0% ➖ noise
16 datafusion:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.5% -0.4% -2.2% +10.0% ➖ noise
16 duckdb:duckdb -1.6% -0.4% -1.2% +10.0% ➖ noise
16 duckdb:vortex-compact -1.3% -0.4% -0.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.7% -0.4% -1.3% +10.0% ➖ noise
17 datafusion:arrow -0.4% -0.4% -0.0% +10.0% ➖ noise
17 datafusion:vortex-compact -1.1% -0.4% -0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.8% -0.4% -1.4% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -0.4% +0.2% +10.0% ➖ noise
17 duckdb:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.6% -0.4% -1.2% +10.0% ➖ noise
18 datafusion:arrow -3.0% -0.4% -2.5% +10.0% ➖ noise
18 datafusion:vortex-compact -1.7% -0.4% -1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.0% -0.4% -1.6% +10.0% ➖ noise
18 duckdb:duckdb +0.2% -0.4% +0.6% +10.0% ➖ noise
18 duckdb:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.2% -0.4% +0.7% +10.0% ➖ noise
19 datafusion:arrow -2.0% -1.3% -0.7% +10.0% ➖ noise
19 datafusion:vortex-compact -3.5% -1.3% -2.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.7% -1.3% -3.4% +10.0% ➖ noise
19 duckdb:duckdb +0.2% -1.3% +1.5% +10.0% ➖ noise
19 duckdb:vortex-compact +0.7% -1.3% +2.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.9% -1.3% +0.4% +10.0% ➖ noise
20 datafusion:arrow -2.8% -0.9% -1.9% +10.0% ➖ noise
20 datafusion:vortex-compact -1.5% -0.9% -0.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.0% -0.9% -1.1% +10.0% ➖ noise
20 duckdb:duckdb -1.0% -0.9% -0.1% +10.0% ➖ noise
20 duckdb:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.1% -0.9% +0.9% +10.0% ➖ noise
21 datafusion:arrow -0.2% -1.2% +1.0% +10.0% ➖ noise
21 datafusion:vortex-compact -1.7% -1.2% -0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
21 duckdb:duckdb -0.9% -1.2% +0.3% +10.0% ➖ noise
21 duckdb:vortex-compact -1.1% -1.2% +0.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.5% -1.2% +0.7% +10.0% ➖ noise
22 datafusion:arrow -2.8% -1.2% -1.6% +10.0% ➖ noise
22 datafusion:vortex-compact +0.1% -1.2% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.1% -1.2% +1.2% +10.0% ➖ noise
22 duckdb:duckdb -3.5% -1.2% -2.3% +10.0% ➖ noise
22 duckdb:vortex-compact -0.9% -1.2% +0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.4% -1.2% -0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish -0.4%


datafusion / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 33350108 34027644 0.98
fineweb_q01/datafusion:vortex-file-compressed 633086564 652244926 0.97
fineweb_q02/datafusion:vortex-file-compressed 668569519 632557411 1.06
fineweb_q03/datafusion:vortex-file-compressed 1329169537 1443706257 0.92
fineweb_q04/datafusion:vortex-file-compressed 1362202357 1370090172 0.99
fineweb_q05/datafusion:vortex-file-compressed 1346602832 1349924457 1.00
fineweb_q06/datafusion:vortex-file-compressed 1542451251 1586500339 0.97
fineweb_q07/datafusion:vortex-file-compressed 1384389935 1411975495 0.98
fineweb_q08/datafusion:vortex-file-compressed 537316870 548044489 0.98
datafusion / vortex-compact (0.967x ➖, 1↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 53144763 32590656 1.63
fineweb_q01/datafusion:vortex-compact 🚀 509559607 730660136 0.70
fineweb_q02/datafusion:vortex-compact 653013455 699870282 0.93
fineweb_q03/datafusion:vortex-compact 1500700094 1484593111 1.01
fineweb_q04/datafusion:vortex-compact 1777052269 1768637672 1.00
fineweb_q05/datafusion:vortex-compact 1465908604 1473449800 0.99
fineweb_q06/datafusion:vortex-compact 1327900672 1587534801 0.84
fineweb_q07/datafusion:vortex-compact 1165186368 1289323174 0.90
fineweb_q08/datafusion:vortex-compact 373324025 408921761 0.91
datafusion / parquet (1.015x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1652902163 1224064857 1.35
fineweb_q01/datafusion:parquet 2277020242 2005701821 1.14
fineweb_q02/datafusion:parquet 1934664081 2016863655 0.96
fineweb_q03/datafusion:parquet 2127607451 2754710733 0.77
fineweb_q04/datafusion:parquet 2259183517 2044724970 1.10
fineweb_q05/datafusion:parquet 1995499448 2235371944 0.89
fineweb_q06/datafusion:parquet 2273019159 2267568417 1.00
fineweb_q07/datafusion:parquet 2205775016 2651751831 0.83
fineweb_q08/datafusion:parquet 2463622303 2021421498 1.22
duckdb / vortex-file-compressed (1.080x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 93565582 89438231 1.05
fineweb_q01/duckdb:vortex-file-compressed 625255035 601530993 1.04
fineweb_q02/duckdb:vortex-file-compressed 507851651 452458638 1.12
fineweb_q03/duckdb:vortex-file-compressed 1588810523 1467565565 1.08
fineweb_q04/duckdb:vortex-file-compressed 1850922100 1657220754 1.12
fineweb_q05/duckdb:vortex-file-compressed 1553781195 1437670685 1.08
fineweb_q06/duckdb:vortex-file-compressed 1818308405 1744607288 1.04
fineweb_q07/duckdb:vortex-file-compressed 1697854816 1534821155 1.11
fineweb_q08/duckdb:vortex-file-compressed 739019214 678187611 1.09
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85512796 82683139 1.03
fineweb_q01/duckdb:vortex-compact 628753593 704005943 0.89
fineweb_q02/duckdb:vortex-compact 613206486 608254441 1.01
fineweb_q03/duckdb:vortex-compact 1701326569 1680734836 1.01
fineweb_q04/duckdb:vortex-compact 1900036150 1695075591 1.12
fineweb_q05/duckdb:vortex-compact 1588411447 1577616342 1.01
fineweb_q06/duckdb:vortex-compact 1566207336 1505070835 1.04
fineweb_q07/duckdb:vortex-compact 1470461431 1409512954 1.04
fineweb_q08/duckdb:vortex-compact 524890492 566837653 0.93
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1199352339 1183944850 1.01
fineweb_q01/duckdb:parquet 1293455504 1362173494 0.95
fineweb_q02/duckdb:parquet 1372004837 1410790479 0.97
fineweb_q03/duckdb:parquet 3657401718 3800134761 0.96
fineweb_q04/duckdb:parquet 1948440283 1943794483 1.00
fineweb_q05/duckdb:parquet 2163394396 2337371858 0.93
fineweb_q06/duckdb:parquet 4432285132 4410878181 1.00
fineweb_q07/duckdb:parquet 2835009758 2743369607 1.03
fineweb_q08/duckdb:parquet 1283188523 1125600536 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +63.1% +17.0% +39.4% +180.6% ➖ noise
0 datafusion:vortex-file-compressed -2.0% +17.0% -16.2% +264.5% ➖ noise
0 duckdb:vortex-compact +3.4% +17.0% -11.6% +65.6% ➖ noise
0 duckdb:vortex-file-compressed +4.6% +17.0% -10.6% +42.4% ➖ noise
1 datafusion:vortex-compact -30.3% +3.8% -32.8% +56.7% ➖ noise
1 datafusion:vortex-file-compressed -2.9% +3.8% -6.5% +72.2% ➖ noise
1 duckdb:vortex-compact -10.7% +3.8% -14.0% +50.4% ➖ noise
1 duckdb:vortex-file-compressed +3.9% +3.8% +0.1% +41.6% ➖ noise
2 datafusion:vortex-compact -6.7% -3.4% -3.4% +36.5% ➖ noise
2 datafusion:vortex-file-compressed +5.7% -3.4% +9.4% +43.1% ➖ noise
2 duckdb:vortex-compact +0.8% -3.4% +4.4% +32.1% ➖ noise
2 duckdb:vortex-file-compressed +12.2% -3.4% +16.2% +41.9% ➖ noise
3 datafusion:vortex-compact +1.1% -13.8% +17.2% +32.1% ➖ noise
3 datafusion:vortex-file-compressed -7.9% -13.8% +6.8% +32.1% ➖ noise
3 duckdb:vortex-compact +1.2% -13.8% +17.4% +32.1% ➖ noise
3 duckdb:vortex-file-compressed +8.3% -13.8% +25.6% +32.1% ➖ noise
4 datafusion:vortex-compact +0.5% +5.2% -4.5% +32.1% ➖ noise
4 datafusion:vortex-file-compressed -0.6% +5.2% -5.5% +32.1% ➖ noise
4 duckdb:vortex-compact +12.1% +5.2% +6.5% +32.1% ➖ noise
4 duckdb:vortex-file-compressed +11.7% +5.2% +6.1% +32.1% ➖ noise
5 datafusion:vortex-compact -0.5% -9.1% +9.5% +32.1% ➖ noise
5 datafusion:vortex-file-compressed -0.2% -9.1% +9.7% +32.1% ➖ noise
5 duckdb:vortex-compact +0.7% -9.1% +10.8% +32.1% ➖ noise
5 duckdb:vortex-file-compressed +8.1% -9.1% +18.9% +32.1% ➖ noise
6 datafusion:vortex-compact -16.4% +0.4% -16.7% +32.1% ➖ noise
6 datafusion:vortex-file-compressed -2.8% +0.4% -3.1% +32.1% ➖ noise
6 duckdb:vortex-compact +4.1% +0.4% +3.7% +32.1% ➖ noise
6 duckdb:vortex-file-compressed +4.2% +0.4% +3.8% +32.1% ➖ noise
7 datafusion:vortex-compact -9.6% -7.3% -2.5% +32.1% ➖ noise
7 datafusion:vortex-file-compressed -2.0% -7.3% +5.8% +32.1% ➖ noise
7 duckdb:vortex-compact +4.3% -7.3% +12.5% +32.1% ➖ noise
7 duckdb:vortex-file-compressed +10.6% -7.3% +19.3% +32.1% ➖ noise
8 datafusion:vortex-compact -8.7% +17.9% -22.5% +42.4% ➖ noise
8 datafusion:vortex-file-compressed -2.0% +17.9% -16.8% +53.2% ➖ noise
8 duckdb:vortex-compact -7.4% +17.9% -21.4% +32.1% ➖ noise
8 duckdb:vortex-file-compressed +9.0% +17.9% -7.6% +32.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.1%


datafusion / vortex-file-compressed (1.002x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1720042 1631532 1.05
clickbench_q01/datafusion:vortex-file-compressed 18756653 19214451 0.98
clickbench_q02/datafusion:vortex-file-compressed 38469814 37906319 1.01
clickbench_q03/datafusion:vortex-file-compressed 42756399 43429419 0.98
clickbench_q04/datafusion:vortex-file-compressed 290419401 281988560 1.03
clickbench_q05/datafusion:vortex-file-compressed 300573925 307067168 0.98
clickbench_q06/datafusion:vortex-file-compressed 1640102 1648901 0.99
clickbench_q07/datafusion:vortex-file-compressed 22986931 22298425 1.03
clickbench_q08/datafusion:vortex-file-compressed 352246848 348923990 1.01
clickbench_q09/datafusion:vortex-file-compressed 543699652 546326264 1.00
clickbench_q10/datafusion:vortex-file-compressed 73639088 74080020 0.99
clickbench_q11/datafusion:vortex-file-compressed 85349457 83714789 1.02
clickbench_q12/datafusion:vortex-file-compressed 275892399 258663325 1.07
clickbench_q13/datafusion:vortex-file-compressed 410015857 406303529 1.01
clickbench_q14/datafusion:vortex-file-compressed 243967224 254406313 0.96
clickbench_q15/datafusion:vortex-file-compressed 324244262 326536063 0.99
clickbench_q16/datafusion:vortex-file-compressed 645042865 636676148 1.01
clickbench_q17/datafusion:vortex-file-compressed 627449224 636459025 0.99
clickbench_q18/datafusion:vortex-file-compressed 1275651600 1263400101 1.01
clickbench_q19/datafusion:vortex-file-compressed 🚨 34625613 29356463 1.18
clickbench_q20/datafusion:vortex-file-compressed 336898161 335022000 1.01
clickbench_q21/datafusion:vortex-file-compressed 366905709 363782975 1.01
clickbench_q22/datafusion:vortex-file-compressed 444004030 439301605 1.01
clickbench_q23/datafusion:vortex-file-compressed 645488566 687740432 0.94
clickbench_q24/datafusion:vortex-file-compressed 43390235 45513763 0.95
clickbench_q25/datafusion:vortex-file-compressed 71029305 72934472 0.97
clickbench_q26/datafusion:vortex-file-compressed 43672610 48478982 0.90
clickbench_q27/datafusion:vortex-file-compressed 724289688 716661176 1.01
clickbench_q28/datafusion:vortex-file-compressed 6502277427 6254743494 1.04
clickbench_q29/datafusion:vortex-file-compressed 229524350 247411374 0.93
clickbench_q30/datafusion:vortex-file-compressed 219181644 218149595 1.00
clickbench_q31/datafusion:vortex-file-compressed 251185996 252369686 1.00
clickbench_q32/datafusion:vortex-file-compressed 1097504915 1082603474 1.01
clickbench_q33/datafusion:vortex-file-compressed 1287002009 1266716033 1.02
clickbench_q34/datafusion:vortex-file-compressed 1274582654 1258876220 1.01
clickbench_q35/datafusion:vortex-file-compressed 446171456 444631805 1.00
clickbench_q36/datafusion:vortex-file-compressed 70196142 70658765 0.99
clickbench_q37/datafusion:vortex-file-compressed 34797964 34853866 1.00
clickbench_q38/datafusion:vortex-file-compressed 18666333 19227076 0.97
clickbench_q39/datafusion:vortex-file-compressed 130756605 128954276 1.01
clickbench_q40/datafusion:vortex-file-compressed 15912427 15891321 1.00
clickbench_q41/datafusion:vortex-file-compressed 15284176 14967808 1.02
clickbench_q42/datafusion:vortex-file-compressed 16858133 16997665 0.99
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1528065 1532816 1.00
clickbench_q01/datafusion:parquet 19033167 18278938 1.04
clickbench_q02/datafusion:parquet 47752877 48087925 0.99
clickbench_q03/datafusion:parquet 37274484 37636523 0.99
clickbench_q04/datafusion:parquet 303602319 293197826 1.04
clickbench_q05/datafusion:parquet 351046454 337741862 1.04
clickbench_q06/datafusion:parquet 1589013 1532996 1.04
clickbench_q07/datafusion:parquet 22597519 22179996 1.02
clickbench_q08/datafusion:parquet 372671853 376847604 0.99
clickbench_q09/datafusion:parquet 610895366 610148867 1.00
clickbench_q10/datafusion:parquet 103207302 103353495 1.00
clickbench_q11/datafusion:parquet 127959400 126550712 1.01
clickbench_q12/datafusion:parquet 342962664 335214761 1.02
clickbench_q13/datafusion:parquet 488842455 486826168 1.00
clickbench_q14/datafusion:parquet 342773181 334782932 1.02
clickbench_q15/datafusion:parquet 333600955 331466338 1.01
clickbench_q16/datafusion:parquet 646067885 652333878 0.99
clickbench_q17/datafusion:parquet 637392669 643232666 0.99
clickbench_q18/datafusion:parquet 1311925295 1284834557 1.02
clickbench_q19/datafusion:parquet 29542108 29087534 1.02
clickbench_q20/datafusion:parquet 592682464 582533015 1.02
clickbench_q21/datafusion:parquet 648918393 647427960 1.00
clickbench_q22/datafusion:parquet 971505211 952496194 1.02
clickbench_q23/datafusion:parquet 3595894242 3525827273 1.02
clickbench_q24/datafusion:parquet 80033222 82898176 0.97
clickbench_q25/datafusion:parquet 129061613 127944869 1.01
clickbench_q26/datafusion:parquet 82232757 84780161 0.97
clickbench_q27/datafusion:parquet 1029934272 1042563093 0.99
clickbench_q28/datafusion:parquet 6588106905 6557469017 1.00
clickbench_q29/datafusion:parquet 239808696 247499654 0.97
clickbench_q30/datafusion:parquet 321880486 312657401 1.03
clickbench_q31/datafusion:parquet 359973630 359179624 1.00
clickbench_q32/datafusion:parquet 1124279279 1206059870 0.93
clickbench_q33/datafusion:parquet 1465624068 1440460597 1.02
clickbench_q34/datafusion:parquet 1460555331 1446382723 1.01
clickbench_q35/datafusion:parquet 454309397 450825970 1.01
clickbench_q36/datafusion:parquet 138470810 134767377 1.03
clickbench_q37/datafusion:parquet 55965587 55907677 1.00
clickbench_q38/datafusion:parquet 83445398 83618035 1.00
clickbench_q39/datafusion:parquet 260147320 253857907 1.02
clickbench_q40/datafusion:parquet 29582401 29417156 1.01
clickbench_q41/datafusion:parquet 27093631 26521059 1.02
clickbench_q42/datafusion:parquet 29410678 28490449 1.03
duckdb / vortex-file-compressed (0.973x ➖, 7↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6071437 5882136 1.03
clickbench_q01/duckdb:vortex-file-compressed 13557939 12995305 1.04
clickbench_q02/duckdb:vortex-file-compressed 25482729 24828629 1.03
clickbench_q03/duckdb:vortex-file-compressed 28897621 30744308 0.94
clickbench_q04/duckdb:vortex-file-compressed 179767471 180126017 1.00
clickbench_q05/duckdb:vortex-file-compressed 174670935 173825671 1.00
clickbench_q06/duckdb:vortex-file-compressed 20014210 20150845 0.99
clickbench_q07/duckdb:vortex-file-compressed 16151396 14896966 1.08
clickbench_q08/duckdb:vortex-file-compressed 254010981 254196412 1.00
clickbench_q09/duckdb:vortex-file-compressed 328736870 331015584 0.99
clickbench_q10/duckdb:vortex-file-compressed 64567023 66365857 0.97
clickbench_q11/duckdb:vortex-file-compressed 75038325 76311245 0.98
clickbench_q12/duckdb:vortex-file-compressed 192716679 192778855 1.00
clickbench_q13/duckdb:vortex-file-compressed 397307412 400752218 0.99
clickbench_q14/duckdb:vortex-file-compressed 231227890 224743078 1.03
clickbench_q15/duckdb:vortex-file-compressed 238747752 242106460 0.99
clickbench_q16/duckdb:vortex-file-compressed 580647580 574399117 1.01
clickbench_q17/duckdb:vortex-file-compressed 478220169 459247313 1.04
clickbench_q18/duckdb:vortex-file-compressed 963967945 965794282 1.00
clickbench_q19/duckdb:vortex-file-compressed 21085126 20304991 1.04
clickbench_q20/duckdb:vortex-file-compressed 316508087 326183356 0.97
clickbench_q21/duckdb:vortex-file-compressed 364994174 360409390 1.01
clickbench_q22/duckdb:vortex-file-compressed 🚨 595751023 497273390 1.20
clickbench_q23/duckdb:vortex-file-compressed 🚀 309375651 365775347 0.85
clickbench_q24/duckdb:vortex-file-compressed 36261822 36503855 0.99
clickbench_q25/duckdb:vortex-file-compressed 78785929 77618400 1.02
clickbench_q26/duckdb:vortex-file-compressed 42776749 46009662 0.93
clickbench_q27/duckdb:vortex-file-compressed 462288668 463346875 1.00
clickbench_q28/duckdb:vortex-file-compressed 2961024599 2958662305 1.00
clickbench_q29/duckdb:vortex-file-compressed 27611774 27689455 1.00
clickbench_q30/duckdb:vortex-file-compressed 184603545 187874299 0.98
clickbench_q31/duckdb:vortex-file-compressed 277980616 274215421 1.01
clickbench_q32/duckdb:vortex-file-compressed 1159275120 1190698989 0.97
clickbench_q33/duckdb:vortex-file-compressed 1113425220 1176833276 0.95
clickbench_q34/duckdb:vortex-file-compressed 1193754650 1191575428 1.00
clickbench_q35/duckdb:vortex-file-compressed 375719724 376829137 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 25947289 29602102 0.88
clickbench_q37/duckdb:vortex-file-compressed 🚀 18793360 22305071 0.84
clickbench_q38/duckdb:vortex-file-compressed 🚀 20245511 23279646 0.87
clickbench_q39/duckdb:vortex-file-compressed 39326603 41713701 0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀 19160847 24399268 0.79
clickbench_q41/duckdb:vortex-file-compressed 🚀 18631183 23816897 0.78
clickbench_q42/duckdb:vortex-file-compressed 🚀 19382227 23644085 0.82
duckdb / parquet (1.005x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25568436 24978557 1.02
clickbench_q01/duckdb:parquet 26900320 28534000 0.94
clickbench_q02/duckdb:parquet 47922538 48647911 0.99
clickbench_q03/duckdb:parquet 38083993 38591753 0.99
clickbench_q04/duckdb:parquet 199761818 200609074 1.00
clickbench_q05/duckdb:parquet 265848737 266452507 1.00
clickbench_q06/duckdb:parquet 45825582 45927207 1.00
clickbench_q07/duckdb:parquet 29126884 29830739 0.98
clickbench_q08/duckdb:parquet 267481739 263927958 1.01
clickbench_q09/duckdb:parquet 393838581 392706881 1.00
clickbench_q10/duckdb:parquet 81889537 80900132 1.01
clickbench_q11/duckdb:parquet 97768496 97761253 1.00
clickbench_q12/duckdb:parquet 282408753 292750789 0.96
clickbench_q13/duckdb:parquet 477669613 474354593 1.01
clickbench_q14/duckdb:parquet 329359343 326549202 1.01
clickbench_q15/duckdb:parquet 256286203 255944743 1.00
clickbench_q16/duckdb:parquet 645119924 630336323 1.02
clickbench_q17/duckdb:parquet 530297721 530159670 1.00
clickbench_q18/duckdb:parquet 1067231638 1054326155 1.01
clickbench_q19/duckdb:parquet 25889927 25406256 1.02
clickbench_q20/duckdb:parquet 420279835 421818610 1.00
clickbench_q21/duckdb:parquet 541045408 543924876 0.99
clickbench_q22/duckdb:parquet 942972711 936472205 1.01
clickbench_q23/duckdb:parquet 304543619 297569867 1.02
clickbench_q24/duckdb:parquet 68138630 68294358 1.00
clickbench_q25/duckdb:parquet 157228132 157229335 1.00
clickbench_q26/duckdb:parquet 48748443 50585269 0.96
clickbench_q27/duckdb:parquet 641424175 639728251 1.00
clickbench_q28/duckdb:parquet 4809703996 4848957139 0.99
clickbench_q29/duckdb:parquet 40796770 41044234 0.99
clickbench_q30/duckdb:parquet 301439709 298349064 1.01
clickbench_q31/duckdb:parquet 358873168 362475575 0.99
clickbench_q32/duckdb:parquet 1146867207 1204662408 0.95
clickbench_q33/duckdb:parquet 1213899948 1217693952 1.00
clickbench_q34/duckdb:parquet 1256566395 1254436745 1.00
clickbench_q35/duckdb:parquet 362474731 359542977 1.01
clickbench_q36/duckdb:parquet 49577011 49776360 1.00
clickbench_q37/duckdb:parquet 34397067 32713776 1.05
clickbench_q38/duckdb:parquet 33743995 32936540 1.02
clickbench_q39/duckdb:parquet 🚨 83695586 72636389 1.15
clickbench_q40/duckdb:parquet 19159685 17745401 1.08
clickbench_q41/duckdb:parquet 18279739 18199174 1.00
clickbench_q42/duckdb:parquet 20776413 20275973 1.02
duckdb / duckdb (0.984x ➖, 3↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18103588 18092362 1.00
clickbench_q01/duckdb:duckdb 32747432 32038159 1.02
clickbench_q02/duckdb:duckdb 43733066 44241494 0.99
clickbench_q03/duckdb:duckdb 47000806 46590073 1.01
clickbench_q04/duckdb:duckdb 186207584 188309393 0.99
clickbench_q05/duckdb:duckdb 261765567 266173184 0.98
clickbench_q06/duckdb:duckdb 28378559 28578206 0.99
clickbench_q07/duckdb:duckdb 35333187 34890228 1.01
clickbench_q08/duckdb:duckdb 249273381 247831090 1.01
clickbench_q09/duckdb:duckdb 366008602 365848479 1.00
clickbench_q10/duckdb:duckdb 97983720 97363738 1.01
clickbench_q11/duckdb:duckdb 107283594 107772648 1.00
clickbench_q12/duckdb:duckdb 238016023 234966612 1.01
clickbench_q13/duckdb:duckdb 468774575 492915093 0.95
clickbench_q14/duckdb:duckdb 275596548 279497016 0.99
clickbench_q15/duckdb:duckdb 215481377 217450828 0.99
clickbench_q16/duckdb:duckdb 623386203 644617196 0.97
clickbench_q17/duckdb:duckdb 528901989 554383540 0.95
clickbench_q18/duckdb:duckdb 1171326281 1190836644 0.98
clickbench_q19/duckdb:duckdb 34097910 34338584 0.99
clickbench_q20/duckdb:duckdb 🚀 887257202 1067970844 0.83
clickbench_q21/duckdb:duckdb 🚀 937605441 1119551660 0.84
clickbench_q22/duckdb:duckdb 1013401323 1104262159 0.92
clickbench_q23/duckdb:duckdb 254148144 250293303 1.02
clickbench_q24/duckdb:duckdb 61812217 61180736 1.01
clickbench_q25/duckdb:duckdb 141292330 141143081 1.00
clickbench_q26/duckdb:duckdb 59682715 59674062 1.00
clickbench_q27/duckdb:duckdb 🚀 967731835 1081662297 0.89
clickbench_q28/duckdb:duckdb 4586451756 4649396702 0.99
clickbench_q29/duckdb:duckdb 48183090 48307458 1.00
clickbench_q30/duckdb:duckdb 264073288 261265263 1.01
clickbench_q31/duckdb:duckdb 417011029 424540704 0.98
clickbench_q32/duckdb:duckdb 1538169068 1574520792 0.98
clickbench_q33/duckdb:duckdb 1968321902 2011349819 0.98
clickbench_q34/duckdb:duckdb 2089932225 2142017069 0.98
clickbench_q35/duckdb:duckdb 285690409 279853855 1.02
clickbench_q36/duckdb:duckdb 38749666 38362498 1.01
clickbench_q37/duckdb:duckdb 29491904 29967596 0.98
clickbench_q38/duckdb:duckdb 31780040 31527762 1.01
clickbench_q39/duckdb:duckdb 64343710 65532762 0.98
clickbench_q40/duckdb:duckdb 31351579 31108379 1.01
clickbench_q41/duckdb:duckdb 30506731 29394741 1.04
clickbench_q42/duckdb:duckdb 31648575 30743604 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +5.4% +1.0% +4.4% +781.8% ➖ noise
0 duckdb:duckdb +0.1% +1.0% -0.9% +291.1% ➖ noise
0 duckdb:vortex-file-compressed +3.2% +1.0% +2.2% +490.4% ➖ noise
1 datafusion:vortex-file-compressed -2.4% -0.9% -1.5% +25.7% ➖ noise
1 duckdb:duckdb +2.2% -0.9% +3.2% +57.5% ➖ noise
1 duckdb:vortex-file-compressed +4.3% -0.9% +5.3% +24.4% ➖ noise
2 datafusion:vortex-file-compressed +1.5% -1.1% +2.6% +16.2% ➖ noise
2 duckdb:duckdb -1.1% -1.1% -0.1% +19.5% ➖ noise
2 duckdb:vortex-file-compressed +2.6% -1.1% +3.8% +13.5% ➖ noise
3 datafusion:vortex-file-compressed -1.5% -1.1% -0.4% +143.9% ➖ noise
3 duckdb:duckdb +0.9% -1.1% +2.0% +37.6% ➖ noise
3 duckdb:vortex-file-compressed -6.0% -1.1% -4.9% +70.3% ➖ noise
4 datafusion:vortex-file-compressed +3.0% +1.5% +1.4% +10.0% ➖ noise
4 duckdb:duckdb -1.1% +1.5% -2.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.5% -1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% +1.8% -3.9% +10.0% ➖ noise
5 duckdb:duckdb -1.7% +1.8% -3.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.5% +1.8% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% +1.7% -2.2% +38.5% ➖ noise
6 duckdb:duckdb -0.7% +1.7% -2.4% +28.3% ➖ noise
6 duckdb:vortex-file-compressed -0.7% +1.7% -2.3% +18.9% ➖ noise
7 datafusion:vortex-file-compressed +3.1% -0.3% +3.4% +15.4% ➖ noise
7 duckdb:duckdb +1.3% -0.3% +1.5% +10.1% ➖ noise
7 duckdb:vortex-file-compressed +8.4% -0.3% +8.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.0% +0.1% +0.8% +10.0% ➖ noise
8 duckdb:duckdb +0.6% +0.1% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +0.1% -0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.5% +0.2% -0.7% +10.0% ➖ noise
9 duckdb:duckdb +0.0% +0.2% -0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% +0.5% -1.1% +10.0% ➖ noise
10 duckdb:duckdb +0.6% +0.5% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.7% +0.5% -3.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.0% +0.6% +1.4% +10.2% ➖ noise
11 duckdb:duckdb -0.5% +0.6% -1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.7% +0.6% -2.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.7% -0.7% +7.4% +10.0% ➖ noise
12 duckdb:duckdb +1.3% -0.7% +2.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.0% -0.7% +0.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.9% +0.6% +0.4% +10.0% ➖ noise
13 duckdb:duckdb -4.9% +0.6% -5.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.9% +0.6% -1.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -4.1% +1.6% -5.6% +10.0% ➖ noise
14 duckdb:duckdb -1.4% +1.6% -3.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.9% +1.6% +1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.7% +0.4% -1.1% +10.0% ➖ noise
15 duckdb:duckdb -0.9% +0.4% -1.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.4% +0.4% -1.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% +0.7% +0.6% +10.0% ➖ noise
16 duckdb:duckdb -3.3% +0.7% -3.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.1% +0.7% +0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.4% -0.4% -1.0% +10.0% ➖ noise
17 duckdb:duckdb -4.6% -0.4% -4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.1% -0.4% +4.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.0% +1.7% -0.7% +10.0% ➖ noise
18 duckdb:duckdb -1.6% +1.7% -3.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.2% +1.7% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +17.9% +1.7% +15.9% +28.5% ➖ noise
19 duckdb:duckdb -0.7% +1.7% -2.4% +17.3% ➖ noise
19 duckdb:vortex-file-compressed +3.8% +1.7% +2.1% +19.2% ➖ noise
20 datafusion:vortex-file-compressed +0.6% +0.7% -0.1% +210.5% ➖ noise
20 duckdb:duckdb -16.9% +0.7% -17.5% +24.2% ➖ noise
20 duckdb:vortex-file-compressed -3.0% +0.7% -3.6% +61.1% ➖ noise
21 datafusion:vortex-file-compressed +0.9% -0.2% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -16.3% -0.2% -16.1% +10.0% ✅ faster
21 duckdb:vortex-file-compressed +1.3% -0.2% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.1% +1.3% -0.3% +14.8% ➖ noise
22 duckdb:duckdb -8.2% +1.3% -9.4% +10.4% ✅ faster
22 duckdb:vortex-file-compressed +19.8% +1.3% +18.2% +15.5% 🚨 regression
23 datafusion:vortex-file-compressed -6.1% +2.2% -8.1% +51.4% ➖ noise
23 duckdb:duckdb +1.5% +2.2% -0.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -15.4% +2.2% -17.2% +17.2% ✅ faster
24 datafusion:vortex-file-compressed -4.7% -1.9% -2.9% +10.0% ➖ noise
24 duckdb:duckdb +1.0% -1.9% +2.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.7% -1.9% +1.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -2.6% +0.4% -3.0% +10.0% ➖ noise
25 duckdb:duckdb +0.1% +0.4% -0.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.5% +0.4% +1.1% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -9.9% -3.3% -6.8% +15.0% ➖ noise
26 duckdb:duckdb +0.0% -3.3% +3.4% +11.0% ➖ noise
26 duckdb:vortex-file-compressed -7.0% -3.3% -3.8% +18.8% ➖ noise
27 datafusion:vortex-file-compressed +1.1% -0.5% +1.5% +10.0% ➖ noise
27 duckdb:duckdb -10.5% -0.5% -10.1% +10.0% ✅ faster
27 duckdb:vortex-file-compressed -0.2% -0.5% +0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +4.0% -0.2% +4.1% +10.9% ➖ noise
28 duckdb:duckdb -1.4% -0.2% -1.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.1% -0.2% +0.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -7.2% -1.9% -5.5% +10.0% ➖ noise
29 duckdb:duckdb -0.3% -1.9% +1.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.3% -1.9% +1.6% +10.2% ➖ noise
30 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
30 duckdb:duckdb +1.1% +2.0% -0.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.7% +2.0% -3.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.5% -0.4% -0.1% +10.0% ➖ noise
31 duckdb:duckdb -1.8% -0.4% -1.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.4% -0.4% +1.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.4% -5.8% +7.6% +10.0% ➖ noise
32 duckdb:duckdb -2.3% -5.8% +3.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.6% -5.8% +3.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.6% +0.7% +0.9% +10.0% ➖ noise
33 duckdb:duckdb -2.1% +0.7% -2.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -5.4% +0.7% -6.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.2% +0.6% +0.7% +10.0% ➖ noise
34 duckdb:duckdb -2.4% +0.6% -3.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +0.2% +0.6% -0.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.3% +0.8% -0.4% +10.0% ➖ noise
35 duckdb:duckdb +2.1% +0.8% +1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.3% +0.8% -1.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.7% +1.2% -1.8% +10.0% ➖ noise
36 duckdb:duckdb +1.0% +1.2% -0.2% +14.9% ➖ noise
36 duckdb:vortex-file-compressed -12.3% +1.2% -13.4% +10.6% ✅ faster
37 datafusion:vortex-file-compressed -0.2% +2.6% -2.7% +10.0% ➖ noise
37 duckdb:duckdb -1.6% +2.6% -4.1% +10.5% ➖ noise
37 duckdb:vortex-file-compressed -15.7% +2.6% -17.9% +10.0% ✅ faster
38 datafusion:vortex-file-compressed -2.9% +1.1% -4.0% +10.0% ➖ noise
38 duckdb:duckdb +0.8% +1.1% -0.3% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -13.0% +1.1% -14.0% +10.9% ✅ faster
39 datafusion:vortex-file-compressed +1.4% +8.7% -6.7% +10.7% ➖ noise
39 duckdb:duckdb -1.8% +8.7% -9.6% +14.0% ➖ noise
39 duckdb:vortex-file-compressed -5.7% +8.7% -13.2% +14.4% ✅ faster
40 datafusion:vortex-file-compressed +0.1% +4.2% -3.9% +11.4% ➖ noise
40 duckdb:duckdb +0.8% +4.2% -3.3% +10.3% ➖ noise
40 duckdb:vortex-file-compressed -21.5% +4.2% -24.6% +15.1% ✅ faster
41 datafusion:vortex-file-compressed +2.1% +1.3% +0.8% +12.7% ➖ noise
41 duckdb:duckdb +3.8% +1.3% +2.5% +10.2% ➖ noise
41 duckdb:vortex-file-compressed -21.8% +1.3% -22.8% +10.1% ✅ faster
42 datafusion:vortex-file-compressed -0.8% +2.8% -3.6% +13.3% ➖ noise
42 duckdb:duckdb +2.9% +2.8% +0.1% +10.8% ➖ noise
42 duckdb:vortex-file-compressed -18.0% +2.8% -20.3% +14.1% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.015x ➖


datafusion / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124736442 122769870 1.02
polarsignals_q01/datafusion:vortex-file-compressed 272587705 283454978 0.96
polarsignals_q02/datafusion:vortex-file-compressed 23469841 22945137 1.02
polarsignals_q03/datafusion:vortex-file-compressed 281786124 267917550 1.05
polarsignals_q04/datafusion:vortex-file-compressed 11489427 11346827 1.01
polarsignals_q05/datafusion:vortex-file-compressed 15095537 15395212 0.98
polarsignals_q06/datafusion:vortex-file-compressed 19247759 18484895 1.04
polarsignals_q07/datafusion:vortex-file-compressed 14454573 13894905 1.04
polarsignals_q08/datafusion:vortex-file-compressed 424499332 423942692 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11491252 11161383 1.03

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 1, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 0.991x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.0%


datafusion / vortex-file-compressed (0.999x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6019008 5586863 1.08
fineweb_q01/datafusion:vortex-file-compressed 21556664 21246320 1.01
fineweb_q02/datafusion:vortex-file-compressed 22057572 21320061 1.03
fineweb_q03/datafusion:vortex-file-compressed 🚀 73742258 89966741 0.82
fineweb_q04/datafusion:vortex-file-compressed 238761864 239479298 1.00
fineweb_q05/datafusion:vortex-file-compressed 216384454 216114353 1.00
fineweb_q06/datafusion:vortex-file-compressed 54010628 51512569 1.05
fineweb_q07/datafusion:vortex-file-compressed 60323000 60687068 0.99
fineweb_q08/datafusion:vortex-file-compressed 21570205 21027364 1.03
datafusion / vortex-compact (0.998x ➖, 0↑ 1↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 6267825 5615114 1.12
fineweb_q01/datafusion:vortex-compact 130359304 129104044 1.01
fineweb_q02/datafusion:vortex-compact 127912325 129283346 0.99
fineweb_q03/datafusion:vortex-compact 1042457069 1050112037 0.99
fineweb_q04/datafusion:vortex-compact 1105707610 1127421375 0.98
fineweb_q05/datafusion:vortex-compact 961148655 963397436 1.00
fineweb_q06/datafusion:vortex-compact 534926239 541762384 0.99
fineweb_q07/datafusion:vortex-compact 546970328 556920149 0.98
fineweb_q08/datafusion:vortex-compact 18511049 19812553 0.93
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7028544 6787424 1.04
fineweb_q01/datafusion:parquet 296369746 296918023 1.00
fineweb_q02/datafusion:parquet 303854705 298099246 1.02
fineweb_q03/datafusion:parquet 296080540 292021957 1.01
fineweb_q04/datafusion:parquet 307412817 301117838 1.02
fineweb_q05/datafusion:parquet 305588243 300836361 1.02
fineweb_q06/datafusion:parquet 292940593 295895780 0.99
fineweb_q07/datafusion:parquet 285177699 288730752 0.99
fineweb_q08/datafusion:parquet 283587179 288906630 0.98
duckdb / vortex-file-compressed (0.959x ➖, 1↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3261093 3463410 0.94
fineweb_q01/duckdb:vortex-file-compressed 🚀 21698479 24374620 0.89
fineweb_q02/duckdb:vortex-file-compressed 24567100 24845413 0.99
fineweb_q03/duckdb:vortex-file-compressed 117029177 123780458 0.95
fineweb_q04/duckdb:vortex-file-compressed 226845223 224393413 1.01
fineweb_q05/duckdb:vortex-file-compressed 206406102 218769261 0.94
fineweb_q06/duckdb:vortex-file-compressed 52444470 53816536 0.97
fineweb_q07/duckdb:vortex-file-compressed 54231483 56349813 0.96
fineweb_q08/duckdb:vortex-file-compressed 22730852 23214986 0.98
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3907248 4027292 0.97
fineweb_q01/duckdb:vortex-compact 105248845 102442903 1.03
fineweb_q02/duckdb:vortex-compact 119694258 114684572 1.04
fineweb_q03/duckdb:vortex-compact 878726368 873131885 1.01
fineweb_q04/duckdb:vortex-compact 909616818 922630413 0.99
fineweb_q05/duckdb:vortex-compact 827435010 816649380 1.01
fineweb_q06/duckdb:vortex-compact 460392676 464132777 0.99
fineweb_q07/duckdb:vortex-compact 483078368 480605990 1.01
fineweb_q08/duckdb:vortex-compact 19518929 19114280 1.02
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 0c4ab52 (ns) base fb0f605 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 32805388 32077251 1.02
fineweb_q01/duckdb:parquet 84937982 88677368 0.96
fineweb_q02/duckdb:parquet 86321276 86122477 1.00
fineweb_q03/duckdb:parquet 318577562 311595946 1.02
fineweb_q04/duckdb:parquet 445202921 442793536 1.01
fineweb_q05/duckdb:parquet 416738865 415626757 1.00
fineweb_q06/duckdb:parquet 200775751 198728356 1.01
fineweb_q07/duckdb:parquet 215505070 208852473 1.03
fineweb_q08/duckdb:parquet 34138659 35583576 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.6% +2.9% +8.5% +48.7% ➖ noise
0 datafusion:vortex-file-compressed +7.7% +2.9% +4.7% +46.1% ➖ noise
0 duckdb:vortex-compact -3.0% +2.9% -5.7% +47.8% ➖ noise
0 duckdb:vortex-file-compressed -5.8% +2.9% -8.5% +80.1% ➖ noise
1 datafusion:vortex-compact +1.0% -2.2% +3.3% +13.3% ➖ noise
1 datafusion:vortex-file-compressed +1.5% -2.2% +3.8% +23.8% ➖ noise
1 duckdb:vortex-compact +2.7% -2.2% +5.1% +14.2% ➖ noise
1 duckdb:vortex-file-compressed -11.0% -2.2% -9.0% +61.7% ➖ noise
2 datafusion:vortex-compact -1.1% +1.1% -2.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +3.5% +1.1% +2.4% +13.4% ➖ noise
2 duckdb:vortex-compact +4.4% +1.1% +3.3% +15.4% ➖ noise
2 duckdb:vortex-file-compressed -1.1% +1.1% -2.2% +10.0% ➖ noise
3 datafusion:vortex-compact -0.7% +1.8% -2.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -18.0% +1.8% -19.5% +47.7% ➖ noise
3 duckdb:vortex-compact +0.6% +1.8% -1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -5.5% +1.8% -7.1% +27.6% ➖ noise
4 datafusion:vortex-compact -1.9% +1.3% -3.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +1.3% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -1.4% +1.3% -2.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +1.3% -0.2% +10.0% ➖ noise
5 datafusion:vortex-compact -0.2% +0.9% -1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +0.9% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +1.3% +0.9% +0.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.7% +0.9% -6.5% +10.0% ➖ noise
6 datafusion:vortex-compact -1.3% +0.0% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.8% +0.0% +4.8% +19.1% ➖ noise
6 duckdb:vortex-compact -0.8% +0.0% -0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.5% +0.0% -2.6% +10.0% ➖ noise
7 datafusion:vortex-compact -1.8% +1.0% -2.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% +1.0% -1.5% +21.9% ➖ noise
7 duckdb:vortex-compact +0.5% +1.0% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.8% +1.0% -4.7% +16.4% ➖ noise
8 datafusion:vortex-compact -6.6% -3.0% -3.7% +24.3% ➖ noise
8 datafusion:vortex-file-compressed +2.6% -3.0% +5.7% +10.0% ➖ noise
8 duckdb:vortex-compact +2.1% -3.0% +5.2% +19.3% ➖ noise
8 duckdb:vortex-file-compressed -2.1% -3.0% +0.9% +54.8% ➖ noise

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 1, 2026

Merging this PR will degrade performance by 16.36%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 14 improved benchmarks
❌ 9 regressed benchmarks
✅ 1183 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation filter_all_true[100000] 7.7 µs 8.8 µs -12.59%
Simulation bench_many_codes_few_values[1024] 436.9 µs 396.3 µs +10.24%
Simulation encode_varbinview[(1000, 2)] 244.3 µs 199.5 µs +22.44%
Simulation filter_all_true[250000] 7.7 µs 8.8 µs -12.59%
Simulation execute_scalar_struct_simple 516.5 µs 468.2 µs +10.31%
Simulation dict_canonicalize_zipfian[16, 1000] 89.3 µs 50 µs +78.52%
Simulation new_bp_prim_test_between[i16, 32768] 134.7 µs 120.3 µs +11.92%
Simulation new_bp_prim_test_between[i32, 16384] 108.8 µs 93.8 µs +15.98%
Simulation patched_take_10k_adversarial 229.5 µs 259.1 µs -11.43%
Simulation new_bp_prim_test_between[i32, 32768] 169.2 µs 140.2 µs +20.72%
Simulation new_bp_prim_test_between[i64, 16384] 143.9 µs 114.4 µs +25.76%
Simulation patched_take_10k_contiguous_patches 288.2 µs 258.9 µs +11.31%
Simulation patched_take_10k_random 300.5 µs 271.2 µs +10.8%
Simulation take_10k_dispersed 240.7 µs 284.5 µs -15.39%
Simulation take_10k_first_chunk_only 226.8 µs 271.2 µs -16.36%
Simulation decompress_rd[f32, (100000, 0.1)] 583.9 µs 495.9 µs +17.75%
Simulation decompress_rd[f32, (100000, 0.01)] 583.9 µs 495.8 µs +17.76%
Simulation decompress_rd[f32, (100000, 0.0)] 496.9 µs 584.2 µs -14.94%
Simulation decompress_rd[f64, (10000, 0.1)] 123.4 µs 139.2 µs -11.38%
Simulation decompress_rd[f64, (100000, 0.1)] 1,022 µs 843.2 µs +21.21%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/vtable-array-outer (ee1a899) with develop (fb0f605)

Open in CodSpeed

Comment thread vortex-array/src/array/typed.rs Outdated
Comment thread vortex-array/src/array/typed.rs Outdated
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement labels May 5, 2026
@joseph-isaacs joseph-isaacs changed the title do not merge: try out a new array memory layout perf[array]: outline the array parts data from the DynArray May 5, 2026
joseph-isaacs and others added 2 commits May 5, 2026 16:41
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

# Conflicts:
#	vortex-array/src/array/erased.rs
#	vortex-array/src/array/mod.rs
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Copy link
Copy Markdown
Contributor

@joseph-isaacs I made it compile but I maybe there's a better way

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026
@joseph-isaacs
Copy link
Copy Markdown
Contributor Author

This seems like a reasonable why to do this for now

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0c4ab52 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@joseph-isaacs joseph-isaacs marked this pull request as ready for review May 6, 2026 09:29
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs requested a review from robert3005 May 6, 2026 10:37
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 merged commit afea5e8 into develop May 6, 2026
65 of 66 checks passed
@robert3005 robert3005 deleted the ji/vtable-array-outer branch May 6, 2026 12:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants